Receiving apparatus and method for display of separately controllable command objects,to create superimposed final scenes

ABSTRACT

A receiving apparatus and method for display of final superimposed scenes from a receiver adapted to receive shared object control information used for forming final superimposed scenes and display final superimposed scenes. The final superimposed scenes are formed by superimposing two or more shared scenes each comprising one or more shared objects. The shared object comprises user-selectable command objects that are separately controllable independent of the shared scenes.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No.09/523,437, filed on Mar. 10, 2000, now U.S. Pat. No. 7,757,157, whichclaims priority from Japanese Application No. JP 11-076598, filed Mar.19, 1999, the disclosures of which is are incorporated herein byreference.

BACKGROUND OF THE INVENTION

The present invention relates to an information processing apparatusused as the so-called authoring tool for creating broadcast contentssuch as MHEG (Multimedia Hypermedia Information Coding Expert Group)contents to be broadcasted along with video information.

In recent years, digital satellite broadcasting has become popular. Incomparison with the contemporary analog broadcasting, for example,digital satellite broadcasting is better at preventing noise and fading,hence, is capable of transmitting a signal with a high quality. Inaddition, the frequency utilization rate is improved and a multi-channeltransmission can also be embraced. To put it concretely, in the case ofdigital satellite broadcasting, several hundreds of channels can bepreserved by using one satellite. In such digital satellitebroadcasting, it is possible to provide a number of special channelssuch as channels for sports, movies, music and news. Programs forspecial plans and contents of the channels are broadcasted through theirrespective channels.

By utilizing such a digital broadcasting system, the user is capable ofdownloading musical data such as a piece of music. There also has beenproposed a system, called television shopping, that allows the user tomake a purchasing contract to buy some products while watching abroadcast screen. That is to say, the digital satellite broadcastingsystem broadcasts additional data services at the same time as anordinary broadcast program.

In the case of an operation to download musical data, for example, thebroadcasting station broadcasts the musical data by multiplexing thedata so as to synchronize the data with a broadcast program or videoinformation. In addition, the user is capable of carrying outdownloading operations interactively while watching a displayed GUI(Graphical User Interface) screen which serves as a downloadingoperation screen. Data for displaying such a GUI screen is alsobroadcasted by multiplexing.

Then, the user owning a reception apparatus selects a desired channel todisplay a GUI screen for downloading musical data by carrying out apredetermined operation on the reception apparatus. The user thencarries out an operation on the GUI screen typically to supply themusical data to a digital audio apparatus connected to the receptionapparatus. Typically, the musical data is recorded in the digital audioapparatus.

Incidentally, with regard to a GUI screen for downloading musical datadescribed above, partial picture data and text data which are used aselements to form the GUI screen and unit data (or files) such as audiodata to be output as a sound in accordance with a predeterminedoperation are each handled as an object. The output format of an objectis controlled by a scenario description according to a predeterminedsystem. That is to say, by broadcasting the so-called multimediacontents, a GUI screen described above is implemented.

It should be noted that a GUI screen for implementing a function toachieve a certain objective by prescription of described information isreferred to as a “scene”. A scene also includes an output such as asound. An “object” is defined as unit information such as a picture, asound or a text with an output format thereof prescribed on the basis ofdescribed information. In addition, during transmission, a data file ofdescribed information itself is also handled as one of the objects.

For example, as a system to prescribe a description of a content forbroadcasting a GUI screen like the one described above, adoption of anMHEG system is conceivable.

In an MHEG prescription, one MHEG content or one MHEG application filetypically comprises one or more scenes. A script is described toprescribe transitions between scenes and outputs which are synchronizedwith typically broadcast pictures of the scenes. In addition, a scene iscontrolled by a description of a script so that one or more objects ofthe scene are displayed in a predetermined display format.

In the broadcasting station, the MHEG content described above is createdin accordance with broadcast contents by using typically a personalcomputer. On the personal computer, application software used as thescript creation tool or an authoring tool is activated. Such applicationsoftware is referred to hereafter as an MHEG authoring tool, a genericname given to the software.

Editing work is carried out typically in scene units by using the MHEGauthoring tool described above. In general, objects to be displayed fora scene are selected and the editor writes a description of a scenarioso as to display the selected objects in desired display formats in thescene. As an alternative, a GUI screen is used as the authoring tool tocreate a scene and editing results are described as a script.

Incidentally, a concept known as a shared object is prescribed in anMHEG application.

A shared object is a file used as an object which is shared amongscenes.

With the contemporary MHEG authoring tool, however, there is providedonly a function of merely selecting whether to use or not use a sharedobject for an MHEG application unit. To put it in detail, it is possibleonly to select an option to display or not to display a shared object asan object common to all scenes comprising an MHEG application.

Consider an attempt to effectively utilize a shared object. In thiscase, it is desirable to set any arbitrary shared object to be used ornot to be used in each of scenes comprising an MHEG application.

If any arbitrary shared object is to be assigned to a scene instead ofbeing assigned to an MHEG application, the option of using or the optionof not using a shared object in a scene must be set by using typically adescription of an action to turn on or off individual objects createdfor the object.

In order to set the option by using a description of such a script, itis necessary for the editor to sufficiently understand the descriptionlanguage. Thus, setting the option is a difficult job for the editor. Inthe end, it is quite within the bounds of possibility that the editorwrites an incorrect description. For this reason, almost no editors usesuch a description to assign any arbitrary shared object to a scene inplace of an MHEG application.

In consequence, shared objects are not utilized effectively in thepresent state of the art. As a result, there are hindrances todiversification of display formats of MHEG contents.

SUMMARY OF THE INVENTION

It is therefore an object of the present invention to address theproblems described above by providing effective utilization of a sharedobject so as to allow the shared object to be handled with easetypically in creation of MHEG contents.

In accordance with an aspect of the present invention, there is providedan information processing apparatus for creating content informationaccording to a predetermined specification wherein the contentinformation includes a scene having an object for creating the contentinformation and at least control information for controlling an outputformat of a scene or an object. The content information defines a sharedobject which can be shared among a plurality of scenes. The informationprocessing apparatus includes a shared-scene definer operable to definea shared scene as an editing material processible in the informationprocessing apparatus where a shared scene is a virtual scene usable as ascene common to a plurality of scenes, a shared-scene creator operableto create the shared scene by using any arbitrary objects in accordancewith a definition generated by the shared-scene definer, a shared-scenesettor operable to set a specific shared scene to be used for each ofthe scenes forming the content information wherein the specific sharedscene is selected among shared scenes created by the shared-scenecreator, a shared-object settor operable to set an object used in thespecific shared scene as a shared object and a control-informationdescriber operable to describe control information for controlling astate of utilization of shared objects in each of the scenes inaccordance with the predetermined specification and in dependence on aresult of setting the specific shared scene carried out by theshared-scene setting means.

According to the configuration described above, the informationprocessing apparatus functions as an authoring tool for creating contentinformation conforming to a predetermined specification and defines ashared scene which is a virtual scene using a shared object usable as anobject common to scenes. During scene editing, an edit operation to seta shared scene to be used for scenes is carried out to allow an objectshared by a plurality of scenes to be handled.

Then, after an object used in a shared scene has been set as a sharedobject, control information for controlling a utilization state of ashared object to be used for scenes in accordance with results ofsetting the shared scene for each scene is described in a formatconforming to the predetermined specification described above.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram showing a typical configuration of a digitalsatellite broadcasting/reception system implemented by an embodiment ofthe present invention;

FIG. 2 is a block diagram showing a typical configuration of a receptionfacility provided by the embodiment;

FIG. 3 is a front-view diagram showing the external appearance of aremote controller for remotely operating an IRD;

FIGS. 4A and 4B are explanatory diagrams showing switching from abroadcast screen to a GUI screen and vice versa;

FIG. 5 is a block diagram showing a typical configuration of a groundstation;

FIG. 6 is a timing chart of data transmitted by the ground station;

FIGS. 7A to 7H are explanatory diagrams showing a time-divisionmultiplexed structure of transmitted data;

FIGS. 8A to 8F are explanatory diagrams showing a DSM-CC transmissionformat;

FIG. 9 is an explanatory diagram showing a typical directory structureof data services;

FIGS. 10A to 10C are diagrams showing the data structure of a transportstream;

FIGS. 11A to 11D are explanatory diagrams showing a table structure of aPSI;

FIG. 12 is an explanatory diagram showing the configuration of the IRD;

FIG. 13 is an explanatory diagram showing the structure of an MHEGcontent;

FIG. 14 is an explanatory diagram showing the structure of an MHEGcontent;

FIG. 15 is an explanatory diagram showing the concept of a shared objectin an MHEG content;

FIGS. 16A to 16F are explanatory diagrams showing an example of sceneediting using shared scenes;

FIGS. 17A to 17D are explanatory diagrams showing an example of sceneediting using shared scenes;

FIGS. 18A and 18B are explanatory diagrams showing the concept ofprocessing embraced by an MHEG authoring tool provided by theembodiment;

FIG. 19 is a block diagram showing functions of the MHEG authoring toolprovided by the embodiment;

FIGS. 20A and 20B are explanatory diagrams showing a typical displayformat of an operation screen implemented by MHEG authoring softwareprovided by the embodiment;

FIG. 21 is a flowchart representing processing operations carried out tocreate a shared scene;

FIG. 22 is a flowchart representing processing operations carried out toset a shared scene for an MHEG scene;

FIG. 23 is a flowchart representing processing operations carried out tooutput shared scene setting data as an MHEG script; and

FIG. 24 is a flowchart representing processing operations carried out tooutput shared scene setting data as an MHEG script.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT

The present invention will become more apparent from a careful study ofthe following detailed description of a preferred embodiment withreference to accompanying diagrams.

An information processing apparatus provided by the present invention isused in a system which allows a program to be broadcasted by means ofdigital satellite broadcasting and information such as musical data oraudio data related to the program to be downloaded on the receiver side.

To be more specific, the information processing apparatus provided bythe present invention is an authoring system for creating contents usedby the broadcasting station as GUI data for typically a downloadingoperation screen as data appended or synchronized to a program (or videoinformation) using digital satellite broadcasting.

In addition, an authoring system implemented by this embodiment is asystem for creating MHEG contents.

It should be noted that the description is given hereafter in thefollowing order:

1 Digital Satellite Broadcasting System

1-1 Overall Configuration

1-2 Operations for a GUI Screen

1-3 Ground Station

1-4 Transmission Format

1-5 IRD

2 Authoring System

2-1 Structure of an MHEG Content

2-2 Concept of a Shared Scene

2-3 Configuration of the MHEG Authoring System

2-4 Typical GUI Screens Displayed as Part of MHEG Authoring Software

2-5 Processing Operations

1 Digital Satellite Broadcasting System

1-1 Overall Configuration

First of all, before explaining an MHEG authoring system implemented bythis embodiment, a digital satellite broadcasting system using MHEGcontents created by using this MHEG authoring system is explained.

FIG. 1 is a block diagram showing the overall configuration of thedigital satellite broadcasting system implemented by this embodiment. Asshown in the figure, a ground station 1 in the digital satellitebroadcasting system receives material for television programbroadcasting from a television program material server 6, musical datafrom a musical data material server 7, audio additional information froman audio additional information server 8 and GUI data from a GUI dataserver 9.

The television program material server 6 is a server for providingmaterial of an ordinary broadcast program. A musical broadcasttransmitted by the television program material server 6 includes movingpictures and sounds. In the case of a musical broadcasting program, forexample, a material of moving pictures and sounds broadcasted by thetelevision program material server 6 are used as moving pictures andsounds typically for promotion of new songs.

The musical data material server 7 is a server for providing an audioprogram by using an audio channel. The material of an audio program islimited to sounds. The musical data material server 7 transmitsmaterials of audio programs by way of a plurality of audio channels.

In program broadcasting through audio channels, a particular piece ofmusic is broadcasted repeatedly at unit time intervals. Audio channelsare independent of each other. A variety of ways to use the audiochannels is conceivable. For example, an audio channel is used forbroadcasting a number of most recent Japanese pop songs repeatedly atfixed intervals while another audio channel is used for broadcasting anumber of most recent foreign pop songs repeatedly at fixed intervals.

The audio additional information server 8 is a server for providinginformation on timing of music provided by the musical data materialserver 7.

The GUI data server 9 provides GUI data (or broadcasting content data)for forming a GUI screen used in conjunction with operations carried outby the user. In the case of formation of a GUI screen for downloadingmusic as will be described later, for example, the GUI data server 9provides, among other information, picture data and text data used forcreating a list page and an information page of pieces of musictransmitted from the GUI data server 9 and data for creating a stillpicture of an album jacket. In addition, the GUI data server 9 alsoprovides EPG (Electrical Program Guide) data used for displaying aprogram in a reception facility 3.

It should be noted that GUI data conforms to typically the MHEG(Multimedia Hypermedia Information Coding Experts Group) system. TheMHEG system is an international standard of scenario description forcreation of a GUI screen. According to the MHEG system, multimediainformation, procedures, operations and their combination are each takenas an object and, after each object has been coded, a title (such as aGUI screen) is created. In the case of this embodiment, the MHEG-5system is adopted.

The ground station 1 transmits pieces of information received from thetelevision program material server 6, the musical data material server7, the audio additional information server 8 and the GUI data server 9by multiplexing the pieces of information with each other.

In this embodiment, video data and audio data received from thetelevision program material server 6 have been subjected to acompression encoding process according to the MPEG2 (Moving PictureExperts Group 2) system and the MPEG2 audio system respectively. On theother hand, audio data received from the musical data material server 7has been subjected to a compression encoding process according totypically either the MPEG2 audio system or the ATRAC (Adoptive TransformAcoustic Coding) system depending on the audio channel.

In the multiplexing process of the pieces of data in the ground station1, the data is encrypted by using a key received from a key informationserver 10.

It should be noted that a typical internal configuration of the groundstation 1 will be described later.

A signal transmitted by the ground station 1 by way of a satellite 2 isreceived by the reception facility 3 of every home. The satellite 2includes a plurality of transponders mounted thereon. A transponder hasa typical transmission power of 30 Mbps. The reception facility 3installed in a home comprises a parabola antenna 11, an IRD (IntegratedReceiver Decoder) 12, a storage device 13 and a monitor unit 14.

A remote controller 64 shown in the figure is used to remotely operatethe IRD 12.

The parabola antenna 11 receives a signal transmitted by the groundstation 1 by way of the satellite 2. The received signal is convertedinto a signal having a predetermined frequency by an LNB (Low NoiseBlock Down Converter) 15 installed on the parabola antenna 11. Thesignal generated by the LNB 15 is supplied to the IRD 12.

General operations carried out by the IRD 12 include selection of asignal transmitted as a predetermined audio signal among signalsreceived by the parabola antenna 11 and demodulation of the selectedsignal to extract video data and audio data as a program and output thevideo and audio data as video and audio signals respectively. The IRD 12also outputs a GUI screen based on GUI data received as multiplexed datain a program. The monitor unit 14 displays a picture of a program andoutputs sounds of the program which have been selected by the IRD 12. Inaddition, the monitor unit 14 is also capable of displaying a GUI screenin accordance with an operation carried out by the user as will bedescribed later.

The storage device 13 is used for storing audio data (or musical data)downloaded by the IRD 12. Not specially limited to a particular storagetype, the storage device 13 can be implemented by an MD (Mini Disc)recorder/player, a DAT recorder/player and a DVD recorder/player. Inaddition, the storage device 13 can also be implemented by a personalcomputer, which is capable of storing audio data in recordable mediasuch as the representative CD-ROM, besides a hard disc.

Furthermore, the reception facility 3 provided by this embodiment mayalso employ an MD recorder/player 13A (FIG. 2) as the storage device 13shown in FIG. 1. As shown in FIG. 2, the MD recorder/player 13A has adata interface conforming to IEEE1394 data transmission specifications.

The IEEE1394 MD recorder/player 13A shown in FIG. 2 is connected to theIRD 12 by an IEEE1394 bus 16. Thus, audio data such as music received bythe IRD 12 in this embodiment, that is, downloaded data, can be recordeddirectly with its compressed/encoded state of the ATRAC system sustainedas it is. In addition, with the IEEE1394 MD recorder/player 13Aconnected to the IRD 12 by an IEEE1394 bus 16, it is also possible torecord jacket data (or still-picture data) of the album and text datasuch as lyrics besides the audio data.

The IRD 12 is capable of communicating with an accounting server 5through typically a telephone line 4. An IC card for recording variouskinds of information as will be described later is inserted into the IRD12. When audio data of music is downloaded, for example, historyinformation on the audio data is recorded onto the IC card. The historyinformation recorded on the IC card is transmitted to the accountingserver 5 at predetermined times and with predetermined timing by way ofthe telephone line 4. The accounting server 5 carries out charging bysetting a transmission fee according to the history information receivedfrom the IRD 12. The transmission fee is then charged to the user.

The ground station 1 transmits video and audio data used as a materialof a musical program broadcast from the television program materialserver 6, audio data used as a material of the audio channel from themusical data material server 7, audio data from the audio additionalinformation server 8 and GUI data from the GUI data server 9 bymultiplexing the pieces of data with each other.

Then, when this broadcast is received by the reception facility 3 of ahome, a program of a selected channel can be watched typically on amonitor unit 14. In addition, an EPG (Electrical Program Guide) screenis displayed as a GUI Screen to allow the user to search the screen fora program. In the second place, by carrying out necessary operations foran EPG screen for a special service the user is capable of receiving aservice other than ordinary programs presented by the broadcastingsystem to the user.

By carrying out an operation for a displayed GUI screen for providing aservice of downloading audio (or musical) data, for example, the user iscapable of downloading the audio data of a desired piece of music andstoring and keeping the data in the storage device 13.

It should be noted that this embodiment exhibits interactivity in a dataservice broadcasting system for rendering special services other thanthe ordinary program broadcasts given in response to operations carriedout for a GUI screen like the one described above. Such an interactivedata service broadcasting system is called an interactive broadcastingsystem.

1-2 Operations for a GUI Screen

The following description briefly explains an example of the interactivebroadcasting system and typical operations to be carried out for a GUIscreen, with reference to FIGS. 3 and 4. In particular, downloading ofmusical data (or audio data) is explained.

The description begins with an explanation of operation keys on a remotecontroller 64 for use by the user to remotely carry out an operation onthe IRD 12 with reference to FIG. 3. Specifically, main keys areexplained.

FIG. 3 is a diagram showing an operation panel surface of the remotecontroller 64. On the panel surface, a variety of switches are laid out.The keys include a power-supply key 101, numeric keys 102, a screendisplay switching key 103, an interactive switching key 104, an EPG keypanel unit 105 and a channel key 106 to be explained as follows.

The power-supply key 101 is operated to turn the power supply of the IRD12 on and off. A numeric key 102 is operated to specify a channel orenter a digit of a number to typically a GUI screen when a numeric inputis required.

The screen display switching key 103 is operated typically for switchingthe monitor display from an ordinary broadcast screen to an EPG screenand vice versa. Assume that an EPG screen is called by operating thescreen display switching key 103. With the EPG screen displayed, a keyprovided on the EPG key panel unit 105 is operated to search the EPGscreen for a program using a display screen of an electronic programguide. An arrow key 105 a provided in the EPG key panel unit 105 can beoperated also for moving a cursor on the GUI screen for renderingservices to be described later.

The interactive switching key 104 is operated for switching the monitordisplay from an ordinary broadcast screen to an GUI screen for renderinga service appended to a broadcast program and vice versa.

The channel key 106 is operated to increase or decrease the number of achannel selected by the IRD 12.

It should be noted that the remote controller 64 provided in thisembodiment has a configuration that allows a variety of operations to becarried out against the monitor unit 14 and includes a variety of keysfor the operations. However, description of the keys to be operated forthe monitor unit 14 is omitted.

Next, an example of operations carried out for a GUI screen is explainedby referring to FIGS. 4A and 4B.

When a broadcast is received by the reception facility 3 and a desiredchannel is selected, a display screen like one shown in FIG. 4A appearson the monitor unit 14. As shown in the figure, the screen displays amoving picture based on program material received from the televisionprogram material server 6. That is to say, the contents of an ordinaryprogram are displayed. In this example, a musical program is displayed.In addition, appended to this musical program is an interactivebroadcast to render a service of downloading audio data of music.

With the musical program displayed on the screen, assume for examplethat the user operates the interactive switching key 104 of the remotecontroller 64. In this case, the monitor display is switched to a GUIscreen like one shown in FIG. 4B for downloading audio data.

In the first place, in a television program display area 21A on the lefttop corner of this GUI screen, a reduced picture of video data of FIG.4A received from the television program material server 6 is displayed.

In addition, on the right top corner of the GUI screen, a list 21B ofpieces of channel music broadcasted through audio channels is displayed.The left bottom corner of the GUI screen is allocated as a text displayarea 21C and a jacket display area 21D. On the right side of the GUIscreen, a lyrics display button 22, a profile display button 23, aninformation display button 24, a reservation-recording button 25, acompleted-reservation-table display button 26, arecording-history-display button 27 and a download button 28 aredisplayed.

While looking at the names of the pieces of music on the list 21B, theuser searches the list 21B for a piece of music which the user isinterested in. If the user finds a piece of music of interest, the usermoves the cursor to the display position of the piece of music ofinterest using the arrow key 105 a and carries out an enter operationtypically by pressing the center position of the arrow key 105 a. Suchan operation, including moving the cursor to a displayed position andcarrying out an enter operation, is hereafter referred to simply as anoperation to press the button or pressing the button.

By doing so, the user is capable of listening to the piece of musicindicated by the cursor on a trial basis. Since the same music isbroadcasted repeatedly during a predetermined unit period of timethrough any audio channel, it is possible to output the sound of themusic of an audio channel selected by operating the IRD 12 and to listento the selected music by switching the monitor display from an originalscreen to the GUI screen with the original screen kept in the televisionprogram area 21A as it is. At that time, the still picture of the CDjacket of the selected music is also displayed on the jacket displayarea 21D as well.

In addition, if the user presses the lyrics display button 22, thelyrics of the selected music are displayed in the text display area 21Cwith timing synchronized to the audio data. By the same token, if theprofile display button 23 is pressed, the profile of an artist for themusic is displayed in the text display area 21C. Likewise, if theinformation display button 24 is pressed, information on the music suchas a concert for the music is displayed on the text display area 21C. Inthis way, the user is capable of knowing what music is broadcasted atthe present time and, furthermore, detailed information on each of thepieces of music.

When the user wants to buy the piece of music of interest to the user,the user presses the download button 28. As the download button 28 ispressed, the audio data of the selected music is downloaded and storedin the storage device 13. It is also possible to download otherinformation such as the lyrics, the profile of the artist and the stillpicture of the jacket along with the audio data of the music.

Each time the audio data of music is downloaded in this way, its historyinformation is stored in an IC card inserted into the IRD 12.Information stored in the IC card is transmitted to the accountingserver 5 typically once a month to be used for computing a fee for dataservices rendered to the user. In this way, the copyright for thedownloaded music can be protected.

When the user wants to make an advance reservation for downloading, theuser presses the reservation recording button 25. As the reservationrecording button 25 is pressed, the monitor display is switched from theGUI screen to a screen fully used for displaying a list of all pieces ofmusic which can be reserved. The list comprises pieces of music obtainedas a result of a search operation carried out typically at hourly orweekly intervals and for each channel. The user then selects a piece ofmusic to be subjected to reserved downloading from the list. Its relatedinformation is stored in the IRD 12. When the user wants to confirm apiece of music already subjected to reserved downloading, the userpresses the completed-reservation-table display button 26 to use theentire screen for displaying a table of pieces of music alreadysubjected to reserved downloading. A piece of music subjected toreserved downloading as described above is downloaded to the IRD 12 andstored in the storage device 13 at a reserved time.

The user is also capable of confirming a piece of music alreadydownloaded. In this case the user presses the recording history button27 to use the entire screen for displaying a list of already downloadedpieces of music.

As described above, in the reception facility 3 of the system to whichthe present invention is applied, a list of pieces of music is displayedon the GUI screen of the monitor unit 14. Then, by selecting a piece ofmusic from the list displayed on the GUI screen, the user is capable oflistening to the selected music and viewing the lyrics and the profileof the artist of the music on a trial basis. The user is also capable ofdisplaying a history of reserved downloading showing a list of pieces ofmusic to be downloaded and a list of pieces of music already downloaded.

A change may be made to the display on a GUI screen and a sound outputmay be programmed in response to an operation carried out by the userfor the GUI screen. Such changes or modifications are implemented byprescribing a relation among objects through a scenario based on theMHEG system described earlier. In this case, an object is picture dataserving as parts corresponding to the buttons or material data displayedin the display areas displayed in FIG. 4B.

In addition, in this specification, a scene is an environment in which aformat to output information to achieve a certain purpose such as thedisplay of a picture or an operation to output a sound is implemented byprescription of a relation among objects through description of ascenario. A file containing the description of a scenario itself is alsohandled as one of the objects forming a scene.

As described above, in a digital satellite broadcasting system to whichthe present invention is applied, a broadcast program is distributed bycommunication. In addition, audio data of music is also broadcastedthrough a plurality of audio channels. The user is allowed to search alist of distributed pieces of music for a desired one and to store theaudio data of the desired music in the storage device 13 with ease.

It should be noted that a variety of conceivable implementations ofservices other than the service of providing programs in the digitalsatellite broadcasting system are not limited to the service ofdownloading of musical data described above. As a conceivable example ofsuch implementation, there is provided the so-called television shoppingwhereby a products-introducing program is broadcasted and a GUI screenis used to make a purchasing contract.

1-3 Ground Station

An overview of the digital satellite broadcasting system implemented byan embodiment of the present invention has been described so far. Thefollowing description explains the system in more detail. Thedescription begins with an explanation of the configuration of theground station 1 with reference to FIG. 5.

The explanation given thereafter is based on the following assumption.

In the transmission of data from the ground station 1 to the receptionfacility 3 by way of the satellite 2 in this embodiment, a DSM-CC(Digital Storage Media-Command and Control) protocol is adopted.

As is already known, the DSM-CC (MPEG-part 6) system prescribes commandsor a control system for retrieving an MPEG-encoded bit stream stored inDSM (Digital Storage Media) or storing such a stream in the DSMtypically by way of some networks. In this embodiment, the DSM-CC systemis adopted as a transmission standard in the digital satellitebroadcasting system.

In order to transmit a content (that is, a set of objects) of a databroadcasting service such as a GUI screen in accordance with the DSM-CCsystem, it is necessary to define the description format of the content.In this embodiment, for definition of this description format, the MHEGsystem explained earlier is embraced.

In the configuration of the ground station 1 shown in FIG. 5, atelevision program material cataloging system 31 catalogs material dataobtained from the television program material server 6 in an AV server35. The material data is supplied to a television program output system39 in which video data is compressed in accordance with typically theMPEG2 system while audio data is converted into packets conforming totypically the MPEG2 audio system. Data output by the television programoutput system 39 is supplied to a multiplexer 45.

A musical data material cataloging system 32 receives material data, oraudio data, from the musical data material server 7 and supplies thematerial data, to an MPEG2 audio encoder 36A and an ATRAC audio encoder36B. In the MPEG audio encoder 36A, the audio data is subjected to anencoding process or, to be more specific, a compression-encodingprocess, before being cataloged in an MPEG audio server 40A. By the sametoken, in the ATRAC audio encoder 36B, the audio data is subjected to anencoding process or, to be more specific, a compression-encodingprocess, before being cataloged in an ATRAC audio server 40B.

The MPEG audio data cataloged in the MPEG audio server 40A is thensupplied to an MPEG audio output system 43A to be converted into packetsbefore being supplied to the multiplexer 45. Likewise, the ATRAC audiodata cataloged in the ATRAC audio server 40B is then supplied to anATRAC audio output system 43B as quadruple-speed ATRAC data to beconverted into packets before being supplied to the multiplexer 45.

An audio additional information cataloging system 33 catalogs materialdata, that is, audio additional information, received from the audioadditional information server 8 into an audio additional informationdata base 37. The audio additional information cataloged in the audioadditional information data base 37 is then supplied to an audioadditional information output system 41 to be converted into packetsbefore being supplied to the multiplexer 45.

A GUI material cataloging system 34 catalogs material data, that is, GUIdata, received from the GUI data server 9 into a GUI material data base38.

The GUI material data cataloged in the GUI material data base 38 is thensupplied to a GUI authoring system 42 for carrying out processing toconvert the GUI material data into data of a format that can be outputas a GUI screen, such as the scene described earlier in FIGS. 4A and 4B.

That is to say, if the scene is a GUI screen for downloading music, forexample, data supplied to the GUI authoring system 42 is still picturedata of an album jacket, text data of lyrics or the like or sound datato be output in accordance with an operation.

The pieces of data cited above are called monomedia data. In the GUIauthoring system 42, an MHEG authoring tool is used to encode the piecesof monomedia data so as to allow them to be handled as objects.

Then, an MHEG-5 content is created along with a scenario descriptionfile (referred to as a script) prescribing a relation among objects soas to obtain a display format of a scene (that is, a GUI screen) likethe one explained earlier by referring to FIG. 4B and a format ofpicture sounds output in response to an operation.

As shown in FIG. 4B, the GUI screen also displays picture/sound datacomprising MPEG video data based on material data received from thetelevision program material server 6 and MPEG audio data based onmusical material data received from the musical data material server 7in an output format according to an operation.

Thus, as the aforementioned scenario description files, the GUIauthoring system 42 handles picture/sound data based on material datareceived from the television program material server 6, MPEG audio databased on musical material data received from the musical data materialserver 7 and audio additional information received from the audioadditional information server 8 as objects when necessary and creates anMHEG script for prescribing the relation among the objects.

It should be noted that data of an MHEG content transmitted by the GUIauthoring system 42 includes script files, a variety of still-picturedata files each handled as object and text files (and audio data files).The still picture data is data of 720 pixels×480 pixels compressed inaccordance with the JPEG (Joint Photograph Experts Group) system whereasthe text data is a file with a size not exceeding typically 800characters.

Data containing MHEG content obtained in the GUI authoring system 42 issupplied to the DSM-CC encoder 44.

The DSM-CC encoder 44 converts the data received from the GUI authoringsystem 42 into a transport stream with a format that can be multiplexedinto a data stream of video and audio data in MPEG2 format. Thetransport stream (TS) is made into a packet and supplied to themultiplexer 45.

The multiplexer 45 multiplexes video and audio packets received from thetelevision program output system 39, audio packets received from theMPEG audio output system 43A, quadruple-speed audio packets receivedfrom the ATRAC audio output system 43B, audio additional informationpackets received from the audio additional information output system 41and GUI data packets received from the GUI authoring system 42 along thetime axis and encrypts them in accordance with key information output bythe key information server 10 shown in FIG. 1.

The multiplexed data output by the multiplexer 45 is supplied to a waveoutput system 46 which typically carries out processing such as additionof error correction codes, and modulation and frequency transformationbefore supplying the multiplexed data to the satellite 2 by way of anantenna.

1-4 Transmission Format

The following description explains a transmission format which isadopted by this embodiment and prescribed on the basis of the DSM-CCsystem.

FIG. 6 is a diagram showing an example of data transmitted by the groundstation 1 to the satellite 2. It should be noted that, as describedbefore, pieces of data shown in the figure are actually multiplexedalong the time axis. In FIG. 6, a period between points of time t1 andt2 shown in the figure is defined as an event. In the case of amusical-program channel, for example, an event is a unit for changing aline-up of a plurality of pieces of music. In this case, the event has alength of approximately 30 minutes to 1 hour.

As shown in FIG. 6, in the event between the points of time t1 and t2, aprogram having predetermined contents A1 is broadcasted as a broadcastof an ordinary moving-picture program. In an event starting at the pointof time t2, contents A2 are broadcasted. In this ordinary program, amoving picture and sounds are broadcasted.

In this example, 10 channels, namely, CH1 to CH10, are provided to serveas MPEG audio channels (1) to (10). Through each of the audio channelsCH1, CH2, CH3, - - - , CH10, the same music is transmitted repeatedlyduring the broadcasting time of an event. To be more specific, duringthe period of the event between the points of time t1 to t2, music B1,music C1 and so on are transmitted repeatedly through audio channelsCH1, CH2 and so on respectively. Through the last audio channel CH10,music K1 is transmitted repeatedly. The repeated transmission describedis also carried out through each of quadruple-speed ATRAC audio channels(1) to (10).

That is to say, an MPEG audio channel indicated by a number enclosed inparentheses ( ) as shown in the timing diagram of FIG. 6 is used fortransmitting the same music as a quadruple-speed ATRAC audio channelindicated by the same number enclosed in parentheses ( ). In addition,audio additional information indicated by a channel number enclosed inparentheses ( ) is added to audio data transmitted through an audiochannel indicated by the same number enclosed in parentheses ( ).Furthermore, still-picture data and text data transmitted as GUI dataare also formed for each audio channel. As shown in FIGS. 7A to 7D,pieces of still-picture data and text data are multiplexed intransmitted MPEG2 transport packets on a time-division basis. As shownin FIGS. 7E to 7H, the packets are demultiplexed in the IRD 12 toreconstruct the original GUI data based on header information of each ofthe packets.

There is at least GUI data among pieces of transmitted data shown inFIGS. 6 and 7A to 7H. As previously discussed, this GUI data is used indata services, such as broadcasting or interactive broadcasting of MHEGcontents synchronized with TV broadcasting or audio broadcasting. ThisGUI data is logically formed in accordance with the DSM-CC system asfollows. The formation of the GUI data is exemplified only by data of atransport stream output by the DSM-CC encoder 44.

As shown in FIG. 8A, files to be transmitted in a data broadcastingservice in this embodiment in accordance with the DSM-CC system are allincluded in a root directory named Service Gateway. Types of objectscontained in the Service Gateway include directories, files, streams andstream events.

Files are individual data files for storing, among other information, astill picture, a sound, a text and a script described in conformity withthe MHEG system.

A stream typically includes information linked to another data serviceand an AV stream such as MPEG video data used as a TV program material,audio data, MPEG audio data used as a musical material and ATRAC audiodata.

A stream event includes links and time information.

A directory is a folder which is a collection of pieces of data relatedto each other.

As shown in FIG. 8B, in the DSM-CC system, these pieces of unitinformation and the Service Gateway itself are each handled as a unitknown as an object which is converted into a format referred to as aBIOP message.

It should be noted that, in the explanation of the present invention,the classification of objects into files, streams and stream events isnot essential. Thus, in the following description, the file is used as arepresentative object.

In addition, in the DSM-CC system, a data unit known as a module shownin FIG. 8C is generated. The module comprises one or more objects whichare each converted into a BIOP message as shown in FIG. 8B. The moduleis a variable-length data unit including an additional BIOP header. Thisdata unit is a buffering unit of data received on the reception side tobe described later.

The DSM-CC system does not specially prescribe nor limit a relationamong objects in the case of a module formed from a plurality ofobjects. In other words, in an extreme case, a module can be formed from2 or more objects in scenes not related to each other at all withoutviolating a prescription based on the DSM-CC system.

In order to transmit data in the form of sections prescribed by an MPEG2format, the module is split into data units each basically having afixed length as shown in FIG. 8D. This data unit is referred to as amechanical block. It should be noted, however, that the last block inthe module is not necessarily required to have a fixed length. Thereason why the module is split into blocks in this way is that, in theMPEG2 format, there is a prescription stating that 1 section shall notexceed 4 KB.

In this case, what is meant by a section is a data unit defined as ablock as described above.

As shown in FIG. 8E, a block obtained as a result of division of amodule described above is converted into a message known as a DDB(Download Data Block) to which a header is added.

Concurrently with the conversion of a block into a DDB described above,control messages called a DSI (Download Server Initiate) and a DII(Download Indication Information) are generated.

The DSI and the DII are information required to acquire a module fromdata received by the IRD 12 on the reception side. The DSI includesmainly an identifier of a data transmission system known as a carousel(FIG. 8F) or module and information on the carousel as a whole,including the time the carousel takes to make 1 rotation and a time-outvalue of the carousel rotation. The information may also include data onthe location of the root directory (Service Gateway) of the dataservices in the case of an object carousel system.

The DII is information corresponding to each module included in acarousel. To be more specific, the DII is information such as the sizeand the version of each module and the time-out value of the module.

Then, as shown in FIG. 8F, the 3 types of messages, namely, the DDB, theDSI and the DII, are output periodically and repeatedly by associatingthe messages with data units. In this way, the receiver is capable ofreceiving a module including an object required to obtain typically thedesired GUI screen (or scene) at any time.

In this specification, the transmission system is called a carouselsystem if we compare the system with a merry-go-round. The datatransmission technique represented by a model shown in FIG. 8F is knownas a carousel.

A carousel may include a plurality of modules. For example, a pluralityof modules required in a data service can be transmitted by using acarousel.

In addition, the carousel system is divided into 2 levels, namely, adata carousel system and an object carousel system. The object carouselsystem is capable of handling a directory structure wherein an objecthaving an attribute of a file, a directory, a stream, a service gatewayor the like is transmitted as data using a carousela significantdifference from the data carousel system. In the system implemented bythis embodiment, the object carousel system is embraced.

FIG. 9 is a diagram showing a typical directory structure of files(strictly speaking, MHEG application files) as a data service accordingto the MHEG system. As described above, the object carousel system ischaracterized in that the system is capable of handling a directorystructure.

Normally, an MHEG application file serving as an entrance to a servicedomain is always a file called app0/startup placed right below theService Gateway.

Basically, beneath the service domain (Service Gateway), applicationdirectories app0, app1, - - - , appN exist. Beneath each of theapplication directories, an application file called startup anddirectories of scenes composing the application exist. The directoriesof scenes are scene0, scene1 and so on. Beneath each of the scenedirectories, an MHEG scene file and content files composing the sceneexist.

In addition, broadcast data including GUI data transmitted by using acarousel as described above, that is, data produced by the multiplexer45 shown in FIG. 5, is output in the form of a transport stream whichhas a typical structure like one shown in FIGS. 10A to 10C.

FIG. 10A is a diagram showing a transport stream. This transport streamis a bit stream defined by the MPEG system. As shown in the figure, thetransport stream is a concatenation of packets (strictly speaking,transport packets) each having a fixed length of 188 bytes.

Each of the transport packets is shown in FIG. 10B. As shown in thefigure, a transport packet comprises a header, an adaptation field forincluding additional information in this particular individual packetand a payload (or a data area) representing contents of the packetincluding video and audio data.

In actuality, the header is typically 4 bytes in length. As shown inFIG. 10C, the header always includes a synchronization byte at thebeginning. At predetermined positions behind the synchronization byte,there are stored a PID (Packet_ID) serving as identification informationof the packet, scramble control information indicating absence/presenceof a scramble and adaptation field control information indicating, amongothers, absence/presence of the subsequent adaptation field and thepayload.

The reception apparatus carries out a descrambling process based onthese pieces of control information in packet units. Then, ademultiplexer can be used for separating and extracting needed packetssuch as video and audio data. In addition, it is also possible toreproduce time information used as a reference of a synchronous playbackoperation of video and audio data.

As is obvious from the description given so far, a transport streamcomprises multiplexed packets of audio and video data pertaining to aplurality of channels. In addition, a signal called PSI (ProgramSpecific Information) for implementing selection of a station,information (EMM/ECM) required for limited reception and SI (ServiceInformation) for implementing services such as an EPG are alsomultiplexed at the same time in the transport stream. The limitedreception is a reception function for determining whether or not it ispossible to receive data through a fee-charging channel in dependence onthe condition of a contract made with an individual.

The PSI which comprises 4 tables is explained by referring to FIGS. 11Ato 11D. Each of the tables is expressed in a format conforming to anMPEG system known as a section format.

FIG. 11A is a diagram showing an NIT (Network Information Table) and aCAT (Conditional Access Table).

The same contents of the NIT are multiplexed for the entire carrier. TheNIT includes transmission parameters such as a plane of polarization, acarrier frequency and a convolution rate as well as a list of channelssuperposed thereon. The PID of the NIT is set at 0x0010.

The same contents of the CAT are also multiplexed for the entirecarrier. The CAT includes the PID of an EMM (Entitlement ManagementMessage) packet which is individual data such as contract informationand an identification of the limited-reception system. The PID of theCAT is set at 0x0001.

FIG. 11B is a diagram showing PATs which are each provided for acarrier. A PAT is information having contents peculiar to the carrierfor which the PAT is provided. A PAT includes channel information in theassociated carrier and the PID of a PMT representing contents ofchannels. Its PID is set at 0x0000.

FIG. 11C is a diagram showing PMTs (Program Map Table) which are eachprovided for a channel. A PMT is information for a channel in thecarrier.

PMTs with contents varying from channel to channel are multiplexed. Forexample, the PID of a PMT shown in FIG. 11D is specified by a PAT. Asshown in the figure, the PMT includes components (such as video andaudio data) composing the channel and the PID of an ECM (EncryptionControl Message) packet required for descrambling.

The SI (not shown) is a table with a section format like the PSI. Thetable includes information on an EPG. On the IRD side, necessaryinformation is extracted from the table and displayed on a screen.

Representative tables of the PSI are an SDT (Service Description Table)and an EIT (Event Information Table).

The SDT represents information on a channel including the number, thename and contents of the channel. Its PID is set at 0x0011.

On the other hand, the EIT represents information on a program includingthe name, the start time, the outline of the program and a genre. ItsPID is set at 0x0012.

1-5 IRD

Next, a typical configuration of the IRD 12 provided in the receptionfacility 3 is explained by referring to FIG. 12.

In the IRD 12 shown in the figure, a signal is received by an inputterminal T1, being supplied to a tuner/front-end unit 51. The signal hasbeen subjected to a predetermined frequency-transformation process inthe LNB 15 of the parabola antenna 11.

The tuner/front-end unit 51 also receives a setting signal includingtransmission parameters from the CPU (Central Processing Unit) 80. Thesetting signal is used to determine the frequency of a carrier to bereceived. The tuner/front-end unit 51 then carries out processing suchas bitabi demodulation and error correction to obtain a transportstream.

The transport stream obtained by the tuner/front-end unit 51 is suppliedto a descrambler 52. In addition, the tuner/front-end unit 51 alsoacquires a PSI packet from the transport stream to update itsinformation on selection of a station. The tuner/front-end unit 51supplies the component PID of each channel obtained from the transportstream to typically the CPU 80 which uses the PID for processing thereceived signal.

The descrambler 52 receives descrambler-key data stored in an IC card 65by way of the CPU 80. A PID is set by the CPU 80. Then, the descrambler52 carries out descramble processing based on this descramble key dataand the PID, supplying a result of the descramble processing to atransport unit 53.

The transport unit 53 comprises a demultiplexer 70 and a queue 71 whichis typically implemented by a DRAM or the like. The queue 71 is an arrayof a plurality of memory areas each corresponding to a module unit. Inthe case of this embodiment, for example, the array comprises 32 memoryareas. Thus, information of up to 32 modules can be stored in the queue71.

The operation of the demultiplexer 70 is explained briefly as follows.In accordance with a filter condition set by a DeMUX driver 82 employedin the CPU 80, a necessary transport packet is extracted from thetransport stream received from the descrambler 52 and, if necessary, thequeue 71 is used as a work area to obtain pieces of data with formatslike the ones shown in FIGS. 7E to 7H. The pieces of data are thensupplied to their respective functional circuits requiring them.

The MPEG video data and the MPEG audio data are separated by thedemultiplexer 70 and supplied to an MPEG2 video decoder 55 and an MPEGaudio decoder 54 respectively. Individual packets of the separated videoand audio data are supplied to their respective decoders in a formatknown as a PES (Packet Elementary Stream).

As for data of MHEG contents in the transport stream, the demultiplexer70 separates and extracts the data from the transport stream intransport-packet units and stores them in appropriate memory areas inthe queue 71 so as to collect the data for each module. The data of MHEGcontents collected for each module is then written into a DSM-CC buffer91 of a main memory 90 to be stored there by way of a data bus undercontrol executed by the CPU 80.

In addition, also in the case of the quadruple-speed ATRAC data (thatis, compressed audio data) in a transport stream, necessary data isseparated and extracted by the demultiplexer 70 typically intransport-packet units which are then output to an IEEE1394 interface60. In addition to audio data, video data and a variety of commandsignals or the like can also be output by way of the IEEE1394 interface60.

The MPEG video data having a PES format supplied to the MPEG2 videodecoder 55 is subjected to a decoding process according to the MPEG2format with a memory 55A used as the work area. The decoded video datais then supplied to a display processing unit 58.

In addition to the decoded video data received from the MPEG2 videodecoder 55, the display processing unit 58 also receives video data suchas a GUI screen for data services obtained from an MHEG buffer 92 of themain memory 90 as will be described later. In the display processingunit 58, the video data received thereby is subjected to necessarysignal processing for converting the data into an analog audio signalconforming to a predetermined television system. The analog audio signalis then output to an analog video output terminal T2.

By connecting the analog video output terminal T2 to a video inputterminal of the monitor unit 14, a screen like the one shown in FIGS. 4Aand 4B can be displayed on the monitor unit 14.

The PES MPEG audio data supplied to the MPEG2 audio decoder 54 issubjected to a decoding process according to the MPEG2 format with thememory 54A used as a work area. The decoded video data is supplied to aD/A converter 56 and an optical digital output interface 59.

In the D/A converter 56, the decoded video data received thereby isconverted into an analog audio signal which is then supplied to a switchcircuit 57. The switch circuit 57 switches the signal path so as tosupply the analog audio signal to either an analog audio output terminalT3 or an analog audio output terminal T4.

The analog audio output terminal T3 is connected to an audio inputterminal of the monitor unit 14. On the other hand, the analog audiooutput terminal T4 is a terminal for outputting downloaded music as ananalog signal.

In addition, the optical digital output interface 59 converts digitalaudio data received thereby into an output optical digital signal. Inthis case, the optical digital output interface 59 conforms typically tothe IEC 958.

The main memory 90 is used as a work area in various kinds of controlprocessing carried out by the CPU 80. In this embodiment, the mainmemory 90 includes areas used as the DSM-CC buffer 91 and the MHEGbuffer 92 described earlier.

The MHEG buffer 92 is a work area used for creating picture data (suchas picture data of a GUI screen) generated in accordance with a scriptconforming to the MHEG system. The picture data generated by using theMHEG buffer 92 is supplied to the display processing unit 58 by way of abus line.

The CPU 80 executes overall control in the IRD 12. Thus, the CPU 80 alsocontrols the separation and the extraction of data in the demultiplexer70.

The CPU 80 also decodes data of MHEG contents acquired thereby in orderto form a GUI screen (or a scene) in accordance with described contentsof a script and output the screen.

In order to accomplish the functions described above, the CPU 80employed in this embodiment is typically provided with at least theDeMUX driver 82, a DSM-CC decoder block 83 and an MHEG decoder block 84in addition to a control processing unit 81. In this embodiment, amongcomponents of the CPU 80, at least the DSM-CC decoder block 83 and theMHEG decoder block 84 are implemented by software.

The DeMUX driver 82 sets a filter condition in the demultiplexer 70 onthe basis of the PID of an input transport stream.

The DSM-CC decoder block 83 functions as a DSM manager, reconstructingdata of MHEG contents for a module unit stored in the DSM-CC buffer 91.In addition, the DSM-CC decoder block 83 also carries out processingrelated to a necessary DSM-CC decoding process in accordance withaccesses from the MHEG decoder block 84.

The MHEG decoder block 84 carries out decode processing for outputting ascene by accessing data of MHEG contents in the DSM-CC buffer 91obtained by the DSM-CC decoder block 83, that is, data of an MHEGcontent obtained in the DSM-CC buffer 91. That is to say, the MHEGdecoder block 84 creates a scene by implementing a relation amongobjects prescribed by a script file of the MHEG content. In the creationof a GUI screen used as the scene, the MHEG buffer 92 is used togenerate data of the GUI screen in accordance with the contents of thescript file.

As an interface between the DSM-CC decoder block 83 and the MHEG decoderblock 84, a U-U API (DSM-CC U-U API (Application Portability Interface))is adopted.

The U-U API is an interface used by a client (the MHEG decoder block 84)for allowing access to a DSM Manager object which is an object forimplementing a DSM function (the DSM-CC decoder block 83). To be morespecific, the U-U API is an API for allowing structural access to treatobjects each having an attribute like a file system. Examples of suchobjects are the Service Gateway, directories, files, streams and streamevents which are included in the carousel.

Thus, access to an object included in the carousel can be made throughthe API by merely specifying a bus name without the necessity for aprogram (or a client) using the carousel to be concerned with a carouselreception operation.

In addition, the U-U API is a set of interfaces prescribed to be usablewithout regard to a data transfer system at a low layer. Thus, a programutilizing this API has a merit of an ability to use this API in any datatransfer system providing the U-U API.

The following description explains a typical operation to extract adesired object required for creation of a scene from a transport streamin accordance with control executed by the CPU 80.

In the DSM-CC protocol, an IOR (Interoperable Object Reference) is usedfor indicating the location of an object in a transport stream. An IORincludes an identifier corresponding to a carousel for finding theobject, an identifier of a module including the object (hereinafter“module id”), an identifier for identifying the object in the module(hereinafter “object key”) and a tag for identifying a DII havinginformation on the module including the object (hereinafter “associationtag”).

The DII having information on the module includes the module id and theassociation tag for each module.

After an IOR extracted from a transport stream is identified by the CPU80, the following processes are carried out for receiving and separatingobjects indicated by the IOR.

1. An ES (elementary stream) loop of the PMT in a carousel is searchedfor an elementary stream having the same value as the associationtag ofthe IOR to obtain a PID. The ES having this PID includes a DII.

2. This PID and a tableidextension are set in the demultiplexer 70 as afilter condition. Under this condition, the demultiplexer 70 thenseparates the DII and outputs it to the CPU 80.

3. In the DII, an associationtag of a module indicated by a moduleidincluded in the IOR is set.

4. The ES loop of the PMT is searched for an ES having the same value asthe associationtag described above and a PID is obtained. The targetmodule is included in an ES having this PID.

5. The demultiplexer 70 carries out filtering using the PID and themoduleid as a filter condition. A transport packet separated andextracted in accordance with this filter condition is stored in a propermemory area (an array) in the queue 71 to eventually form a targetmodule.

6. A target object corresponding to an objectkey included in theaforementioned IOR is taken out from the target module. The targetobject is written into a predetermined area of the DSM-CC buffer 91.

Typically, the above operation is carried out repeatedly to collecttarget objects and store them in the DSM-CC buffer 91. In this way, anMHEG content for creating a required scene is obtained.

A man-machine interface 61 receives a command signal transmitted by aremote controller 64, supplying the signal to the CPU 80. The CPU 80then carries out necessary control processing to accomplish an apparatusoperation according to the command signal received from the man-machineinterface 61.

An IC card 65 is inserted into the IC card slot 62. The CPU 80 writesand reads out information into and from the IC card 65.

The modem 63 is connected to the accounting server 5 by a telephone line4 and controlled by the CPU 80 to allow the IRD 12 to communicate withthe accounting server 5.

The following description complementarily explains the flow of a signalserving as a video/audio source in the IRD 12 with reference to thedisplay format explained earlier by referring to FIGS. 4A and 4B.

In processing to output an ordinary program shown in FIG. 4A, MPEG videodata and MPEG audio data required for the program are extracted from aninput transport stream and then subjected to their respective decodingprocesses. Subsequently, the MPEG video data and the MPEG audio data areoutput to the analog video output terminal T2 and the analog audiooutput terminal T3 respectively to have the monitor unit 14 display apicture and generate sounds of the broadcast program.

In processing to output a GUI screen shown in FIG. 4B, on the otherhand, data of an MHEG content required for the GUI screen (or a scene)is separated and extracted by a transport unit 53 from an inputtransport stream and supplied to the DSM-CC buffer 91. Then, the DSM-CCdecoder block 83 and the MHEG decoder block 84 function to createpicture data of the scene (the GUI screen) in the MHEG buffer 92 byusing the extracted data. Subsequently, the picture data is supplied tothe analog video output terminal T2 by way of a display processing unit58 to display the GUI screen on the monitor unit 14.

Assume that a piece of music is selected from the musical list 21Bdisplayed on the GUI screen shown in FIG. 4B and the audio data of theselected music is listened to by the user on a trial basis. In thiscase, the MPEG audio data of the selected music is generated by thedemultiplexer 70. The MPEG audio data is then output to the monitor unit14 as an analog audio signal by way of an MPEG audio decoder 54, a D/Aconverter 56, a switch circuit 57 and the analog audio output terminalT3.

Assume that the download button 28 displayed on the GUI screen shown inFIG. 4B is pressed to download musical audio data. In this case, themusical audio data to be downloaded is extracted by the demultiplexer 70and supplied to the analog audio output terminal T4, the optical digitaloutput interface 59 or the IEEE1394 interface 60.

Assume that an MD recorder/player 13A of FIG. 12 conforming to theIEEE1394 specifications is connected to the IEEE1394 interface 60. Inthis particular case, the demultiplexer 70 extracts quadruple-speedATRAC data of the downloaded music and outputs the data to the IEEE1394interface 60 to be recorded onto a disc mounted on the MDrecorder/player 13A. At the same time, the demultiplexer 70 alsoextracts still picture data of the album jacket and text data such asthe lyrics and the profile of an artist from the transport stream, andsupplies the data to the MD recorder/player 13A by way of the IEEE1394interface 60. It should be noted that the data in the transport streamhas been compressed in accordance with typically the JPEG system. Thestill picture data and the text data are recorded into a predeterminedarea in a disc mounted on the MD recorder/player 13A.

2 Authoring System

2-1 Structure of MHEG Content

Next, an MHEG authoring system provided by this embodiment is explained.

In the case of FIG. 5, the MHEG authoring system of this embodimentexplained below corresponds to the GUI authoring system 42. It should benoted, however, that since a personal computer is actually used forcreating or obtaining GUI material data (such as a text file or apicture used as an object) in order to carry out authoring work,functionally, the GUI material cataloging system 34 and the GUI materialdata base 38 can be included in addition to the GUI authoring system 42.

FIGS. 13 and 14 are diagrams conceptually showing the structure of anMHEG content created by the MHEG authoring system provided by thisembodiment.

To be more specific, FIG. 13 is a diagram showing 3 scenes, namely, MHEGscene 1 to MHEG scene 3. Each of the scenes is formed as a combinationof objects pasted on a picture area with a size of typically onepicture.

It should be noted that an MHEG scene is a scene conforming to the MHEGsystem. In this specification, a scene is referred to as an MHEG scenein some cases in order to distinguish it from a shared scene to bedescribed later. Conversely speaking, in the following description, by ascene, an MHEG scene is meant.

As described earlier, an object is interpreted as, among other things,picture information such as a JPEG or GIF still-picture file, textinformation, a part picture file such as an operation button and anaudio data file. In the case of this embodiment, the monitor display isswitched from one scene to another in synchronization with typically aTV broadcast or switched by an operation of the switch button. In thisembodiment, switching of the monitor display from one scene to anotheris referred to as a transition.

Assume for example that the 3 scenes, namely MHEG scene 1 to MHEG scene3, are related to each other in accordance with a consistent relationsuch as a relation allowing a transition to occur between any two ofthem. The relation among them is arranged into a scenario unit (or MHEGapplication unit).

The scenario used in this case has a meaning different from adescription file used as a script. That is to say, a scenario implies acontent unit at a hierarchical layer of an MHEG application. A scenariounit is typically provided with pieces of information such as a datatype, customized info, a scene number and information called an ES name,which is the name of the elementary stream to which the present scenariois output, and is formed to include 1 or more MHEG scenes. It should benoted that the datatype is the data type of the present scenario. Anexample of the data type is “mheg”. The customizedinfo is customizedinformation and the scenenumber is the number of scenes included in thescenario.

A set of scenarios which are each an arrangement of scenes forms an MHEGcontent as shown in FIG. 14.

In an example shown in the figure, the MHEG content comprises 3scenarios, namely, scenarios SC1, SC2 and SC3. Scenario SC1 comprises 3scenes, namely, scenes 1, 2 and 3. The remaining scenarios SC2 and SC3comprise MHEG scenes 4 and 5 respectively.

As shown in FIG. 13, objects are used for creating a scene. According toMHEG specifications, a shared object can also be used.

A shared object is an object that can be used by being shared among aplurality of scenes forming an MHEG application.

An example of shared objects is shown in FIG. 15. As shown in thefigure, 1 MHEG application comprises 2 scenes, namely, MHEG scenes 1 and2. The MHEG content includes 6 prepared objects, namely, objects 1 to 3and 4 to 6 in addition to 3 shared objects, namely, shared objects 1 to3.

Objects 1 to 3 are used for creating only MHEG scene 1 while objects 4to 6 are used for creating only MHEG scene 2.

On the other hand, shared objects 1 to 3 are each an object that can beset as an object usable and sharable by both MHEG scenes 1 and 2.

Thus, in the case of the example shown in FIG. 15, MHEG scene 1 can becreated by using objects 1 to 3 and shared objects 1 to 3 while MHEGscene 2 can be created by using objects 4 to 6 and shared objects 1 to3.

As explained earlier in the description of the conventional apparatus,the interface of the contemporary MHEG authoring tool allows the user tocarry out only editing work of setting a flag indicating whether or nota shared object is to be used for all of a plurality of scenesconstituting an MHEG application even if a shared object can be set.

In the case of the example shown in FIG. 15, if shared objects 1 to 3are set for use, for instance, it is possible to obtain only states inwhich shared objects 1 to 3 are always used and displayed for MHEGscenes 1 and 2. If shared objects 1 to 3 are set for no use, on theother hand, it is possible to obtain only states in which shared objects1 to 3 are not displayed for both MHEG scenes 1 and 2.

Conversely speaking, it is impossible to set usage of objects in which,for example, shared objects 1 and 2 are selected for MHEG scene 1whereas shared object 3 is selected for MHEG scene 2. In an attempt tocarry out editing work using a shared object with a high degree offreedom, it becomes necessary to write a script for controlling theshared objects themselves. For this reason, the editor must beproficient in the script language as has been described earlier.

As will be described below, the MHEG authoring tool provided by thisembodiment is configured to provide a simple interface which can be usedby anybody but allows a shared object to be set for a scene with a highdegree of freedom.

2-2 Concept of a Shared Scene

A shared scene is prescribed in the editing process based on an internalformat of the MHEG authoring tool provided by this embodiment.

A shared scene is a virtual scene which is created by using one or morearbitrary objects. A shared scene is handled as a layer-like editmaterial to be used or displayed by superposition on a prepared MHEGscene. In addition, a shared scene is used by being shared among MHEGscenes forming one MHEG application.

FIGS. 16A to 16F are explanatory diagrams showing the concept of a basicediting operation using shared scenes.

Assume that shared scenes 1 and 2 shown in FIGS. 16A and 16B have beencreated and prepared by using the MHEG authoring tool provided by thisembodiment. In this case, shared scene 1 is created into a state inwhich object ob1 is displayed at a position shown in the figure. Objectob1 shown in shared scene 1 is a partial picture of an operation buttonmarked with “Next”. On the other hand, shared scene 2 is created into astate in which object ob2 is displayed at a position shown in thefigure. Object ob2 shown in shared scene 2 is a partial picture of anoperation button marked with “Return”.

It should be noted that a shared scene can be created by carrying outnecessary editing operations using a material comprising a variety ofobjects in an environment of the MHEG authoring tool provided by thisembodiment.

Shared scenes 1 and 2 are set so that they can be used in an MHEGcontent provided with 4 scenes, namely, MHEG scenes 1 to 4 as shown inFIGS. 16C to 16F respectively. MHEG scenes 1 to 4 are edited to displaythe operation buttons “Next” and/or “Return” so as to allow transitionsdescribed later to take place as shown in FIGS. 16C to 16F.

MHEG scene 1 shown in FIG. 16C is a scene serving as a base point of thetransitions. That is why only the Next operation button is displayedthereon. MHEG screen 1 is prescribed so that, when this Next button isoperated, a transition from MHEG scene 1 to MHEG scene 2 takes place.

MHEG scene 2 shown in FIG. 16D displays both the Next and Returnoperation buttons. MHEG screen 2 is prescribed so that, when the Nextbutton is pressed, a transition from MHEG scene 2 to MHEG scene 3 takesplace and, when the Return button is pressed, on a transition from MHEGscene 2 back to MHEG scene 1 takes place.

By the same token, MHEG scene 3 shown in FIG. 16E displays both the Nextand Return operation buttons. MHEG screen 3 is prescribed so that, whenthe Next button is pressed, a transition from MHEG scene 3 to MHEG scene4 takes place and, when the Return button is pressed, a transition fromMHEG scene 3 back to MHEG scene 2 takes place.

MHEG scene 4 shown in FIG. 16F is a scene serving as the last scene ofthe transitions. That is why only the Return operation button isdisplayed thereon. MHEG screen 4 is prescribed so that, when the Returnbutton is pressed, a transition from MHEG scene 4 back to MHEG scene 3takes place.

It should be noted that, in actuality, each of MHEG scenes 1 to 4generally displays scene objects at the same time too. In this case,however, only objects included in shared scenes are displayed for thesake of clarity. In addition, a shared scene provided by this embodimentmay be created in general to use a plurality of objects. In thisexample, however, shared scenes 1 and 2 include only 1 object forclarity of expression.

As described above, MHEG scenes 1 to 4 are edited to include theoperation buttons “Next” and/or “Return” so as to allow the transitionsto take place. In order to display either or both of the operationbuttons, a relation among MHEG scenes and shared scenes needs to bedescribed.

First of all, when MHEG scene 1 is edited, shared objects 1 and 2 areset at ON (RUN) and OFF (STOP) states respectively as shown at thebottom of MHEG scene 1 of FIG. 16C. In these states, only shared objectob1 is selected and used in MHEG scene 1. That is to say, the editingwork results in a state in which MHEG scene 1 displays shared object ob1but not shared object ob2 as shown in FIG. 16C.

Then, when MHEG scene 2 is edited, shared objects ob1 and ob2 are bothset at an ON (RUN) state as shown at the bottom of MHEG scene 2 of FIG.16D. In this state, both shared objects ob1 and ob2 are selected andused in MHEG scene 2. That is to say, the editing work results in astate in which MHEG scene 2 displays both shared object ob1 and sharedobject ob2 as shown in FIG. 16D. By the same token, when MHEG scene 3 isedited, shared objects ob1 and ob2 are both set at an ON (RUN) state asshown at the bottom of MHEG scene 3 of FIG. 16E. In this state, bothshared objects ob1 and ob2 are selected and used in MHEG scene 3. Thatis to say, the editing work results in a state in which MHEG scene 3displays both shared object ob1 and shared object ob2 as shown in FIG.16E.

Finally, when MHEG scene 4 is edited, shared objects ob2 and ob1 are setat ON (RUN) and OFF (STOP) states respectively as shown at the bottom ofMHEG scene 4 of FIG. 16F. In these states, only shared object ob2 isselected and used in MHEG scene 4. That is to say, the editing workresults in a state in which MHEG scene 4 displays shared object ob2 butnot shared object ob1 as opposed to the display of MHEG scene 1.

As described above, a shared scene is a virtual scene which can be usedby being shared among MHEG scenes constituting an MHEG content. As aresult, an object used for such a shared scene is an object used bybeing shared among MHEG scenes constituting an MHEG content. That is tosay, an object used for such a shared scene is the same as a sharedobject defined in the MHEG specifications.

In other words, shared objects are not controlled individually in thisembodiment. Instead, shared objects are each controlled as an objectincluded in a shared scene.

If a plurality of shared scenes are used for 1 MHEG scene in thisembodiment, an order of superposition of the shared scenes on the MHEGscene should be specified. As a rule, when a plurality of shared scenesare used for 1 MHEG scene in this embodiment, the shared scenes aresuperposed on each other in a specified order to create a picture whichis then placed in front of or on the picture of the MHEG scene.

FIGS. 17A to 17D are explanatory diagrams showing typical displays ofscenes superposed in a specified order.

In the example shown in the figure, 2 shared scenes, namely, sharedscenes 3 and 4, are prepared as shown in FIGS. 17A and 17B respectively.Shared scene 3 is formed to include object ob3 of an ON button picturedisplayed at a position shown in the figure. On the other hand, sharedscene 4 is formed to include object ob4 of an OFF button picturedisplayed at a position shown in the figure. The position of object ob3on shared scene 3 coincides with the position of object ob4 on sharedscene 4.

Shared scenes 3 and 4 are both put in an ON (RUN) stateand shared byMHEG scenes 1 and 2. FIG. 17C is a diagram showing MHEG scene 1 usingshared scenes 3 and 4. On the other hand, FIG. 17D is a diagram showingMHEG scene 2 using also the 2 shared scenes, namely shared scenes 3 and4.

As shown at the bottom of FIG. 17C, in the order of superposition ofshared scenes 3 and 4, shared scenes 3 and 4 are superposed on MHEGscene 1 with shared scene 3 put at the front end and shared scene 4 putat the rear end.

As a result, only object ob3 representing the ON button picture isvisible on MHEG scene 1 as shown in FIG. 17C. On the other hand, objectob4 representing the OFF button picture is concealed behind object ob3and, hence, invisible.

Thus, MHEG scene 1 is a GUI screen whereby when the ON button ispressed. MHEG a transition takes place to replace MHEG scene 1 by MHEGscene 2.

In the case of MHEG scene 2, on the other hand, in the order ofsuperposition of shared scenes 3 and 4, shared scenes 3 and 4 aresuperposed on MHEG scene 2 with shared scene 4 put at the front end andshared scene 3 put at the rear end as shown at the bottom of FIG. 17D.

As a result, only object ob4 representing the OFF button picture isvisible on MHEG scene 2 as shown in FIG. 17D. On the other hand, objectob3 representing the ON button picture is concealed behind object ob4and, hence, invisible.

Thus, MHEG scene 2 is a GUI screen whereby when the OFF button ispressed a transition takes place to replace MHEG scene 2 by MHEG scene1.

Thus, when the user looks at the real GUI screen, the screen is switchedfrom a display of the ON button picture to a display of the OFF buttonpicture or vice versa each time the ON or OFF button is operatedrespectively.

As described above, shared objects are handled in the MHEG authoringtool provided by this embodiment in a configuration wherein the sharedobjects are controlled by shared scenes. Thus, by setting whether or notto use a shared scene in an MHEG scene as described by referring toFIGS. 16A to 16F, shared objects for each MHEG scene can be selected foruse in the MHEG scene. In addition, by specifying an order ofsuperposition of shared scenes as described earlier by referring toFIGS. 17A to 17D, it is possible to provide an editing effect wherein,while shared objects are used by being shared among a plurality of MHEGscenes, the display is capable of transiting from one scene to another.

In an attempt to carry out editing work for displays of objects likeones shown in FIGS. 16C to 16F given earlier in an authoring toolwithout introducing the concept of a shared scene, for example, first ofall, it is necessary to set objects ob1 and ob2 each as a shared objectand, then, to describe a script prescribing that objects ob1 and ob2 areproperly placed at positions in MHEG scenes 1 to 4 as shown in FIGS. 16Cto 16F respectively.

The editing work shown in FIGS. 17A to 17D is carried out in a similarway. That is to say, first of all, objects ob3 and ob4 are eachprescribed as a shared object. Then, it is necessary to prescribe ascript including an order of superposition of shared objects ob3 and ob4for MHEG scene 1 so as to give a display state like the one shown inFIG. 17C. By the same token, it is necessary to prescribe a scriptincluding an order of superposition of shared objects ob3 and ob4 forMHEG scene 2 so as to give a display state like the one shown in FIG.17D.

In order to carry out such editing work, it is necessary for the editorto have sufficient knowledge of a script language that enables theeditor to do editing work of shared objects. Thus, a result of theediting work much relies on the skill owned by the editor. For thisreason, the editor is capable of creating only a simple scene usingshared objects due to, for example, the fact that the editor is capableof describing only a very simple script. In another case, a script isdescribed incorrectly due to the fact that the editor is not familiarwith the script language.

The present authoring tools only have the functionality of turning ashared object on and off simultaneously for all scenes. Thus it isdifficult to utilize a shared object effectively.

In the case of this embodiment, on the other hand, the editor carriesout editing work by, first of all, creating a shared scene usingselected objects each as a shared object and, creating an image obtainedas a result of superposition of the shared scene on an MHEG scene. As aresult, the editing work creates a visual image with ease.

2-3 Configuration of the MHEG Authoring System

Next, the configuration of an MHEG authoring system provided by thisembodiment is explained.

As described above, the MHEG authoring system provided by thisembodiment is capable of editing MHEG contents defining shared scenes.However, processing carried out by the MHEG authoring tool including theediting work using such a shared scene can be conceptually configuredinto a typical MHEG authoring tool as shown in FIGS. 18A and 18B.

Processing carried out by the MHEG authoring tool is classified into 2large categories, namely, editing work shown in FIG. 18A and conversionwork shown in FIG. 18B. The editing work is carried out in accordancewith an internal format in this MHEG authoring tool to create an MHEGapplication file or an MHEG content. On the other hand, the conversionwork is carried out to convert an MHEG content created by the editingwork carried out in accordance with the internal format in this MHEGauthoring tool into data of the so-called MHEG-IS format conforming tothe actual MHEG specifications.

The MHEG-IS format is the format of an MHEG content with substancesconforming to MHEG specifications. In this case, the MHEG-IS format is aformat for outputting contents for data broadcasting.

That is to say, the MHEG authoring tool provided by this embodiment hasa configuration wherein editing processing is carried out in accordancewith an internal format in the MHEG authoring tool, shared scenes andthe like which do not exist in the actual MHEG specifications aredefined and editing processing using the defined shared scenes and thelike can be implemented. Conversely speaking, operations can betypically carried out in a GUI-like interface so as to allow the editorto perform advanced editing by carrying out simpler operations withoutthe need for doing sophisticated work such as writing a scriptconforming to the MHEG specifications.

It should be noted, however, that the substance of an edit of an MHEGcontent (that is, a description such as a definition statement)conforming to the internal format of the MHEG authoring tool is validonly in the MHEG authoring tool. Thus, in order to allow the contents ofthe description conforming to the internal format to be decoded anddisplayed on the receiver side, it is necessary to convert the contentsof the description into a description with contents conforming to theMHEG specifications. Thus, the configuration of MHEG authoring tool isdesigned to such that the description created by the edit processingaccording to the internal format as shown in FIG. 18A is converted intoa description with contents conforming to the MHEG-IS format by theconversion processing shown in FIG. 18B.

Using the above description as a basis, the following detaileddescription explains the concept of processing in the MHEG authoringtool provided by this embodiment to do editing work using shared sceneswith reference to FIGS. 18A and 18B.

As shown in FIG. 18A, in the MHEG authoring tool, editing work iscarried out on an MHEG content comprising 2 scenes, namely, MHEG scene 1and MHEG scene 2. Three files, namely, shared-object files 1, 2 and 3are created and prepared each as a shared object that can be used byMHEG scene 1 and MHEG scene 2. Shared-object file 1 is created by usingobjects 1 and 2 whereas shared-object file 2 is created by using objects3 and 4. As for creation of shared-object file 3, objects 5 and 6 areused.

Here, assume that the editor edits scenes in an environment of the MHEGauthoring tool. In this case, MHEG scene 1 is edited by usingshared-scene files 1 and 2 to produce its desired display format whereasMHEG scene 2 is edited by using a shared-scene file 3 to produce itsdesired display format.

Then, in the MHEG authoring tool, a shared-scene definition statement 1of shared-scene files 1 and 2 is formed as “authoring controlinformation” in accordance with actual results of the editing for MHEGscene 1 whereas a shared-scene definition statement 2 of shared-scenefile 3 is formed as other “authoring control information” in accordancewith the actual results of the editing for MHEG scene 2.

Here, the concept of a shared scene is prescribed in the MHEG authoringtool provided by this embodiment. However, the prescription itself isnot included in the brief description of the MHEG-IS format. On theother hand, the MHEG-IS system prescribes a description formatindicating how individual shared objects are used for each MHEG scene.

For this reason, in the processing to output a result of editing byusing a shared scene in the MHEG authoring tool provided by thisembodiment as described above, that is, the processing to output adescription of authoring control information (or shared-scene definitionstatements) in the MHEG-IS format, it is necessary to convert thedescription into description contents of a script (or controlinformation) used in executing control of individual shared-object unitsin accordance with the MHEG description outline.

Thus, in the MHEG authoring tool provided by this embodiment, thedescription is converted into an output with the MHEG-IS format as shownin FIG. 18B.

In this conversion, first of all, objects 1 to 6 used in shared-scenefiles 1, 2 and 3 as shown in the left-hand-side diagram of FIG. 18B areprescribed in an MHEG content (or an MHEG application file) as sharedobjects 1 to 6 and controlled as a set of shared objects.

Then, for MHEG scene 1, a link for controlling shared objects 1 to 4 isdescribed in a description file which is provided to the MHEGapplication file as shown in the right-hand-side diagram of FIG. 18B.

By the same token, for MHEG scene 2, a link for controlling sharedobjects 5 and 6 is described in a description file which is provided tothe MHEG application file.

Then, the MHEG application file converted into the MHEG-IS format asdescribed above is output as a content for a data broadcast multiplexedin a digital satellite broadcast. If the configuration of the groundstation 1 shown in FIG. 5 is taken as an example, the MHEG applicationfile converted into the MHEG-IS format is data output from the MHEGauthoring tool 42 to the DSM-CC encoder 44.

In the reception facility 3, for example, the digital satellitebroadcast with the content for a data broadcast multiplexed therein isreceived by the IRD 12 and subjected to processing such as an MHEGdecoding process in the CPU 80 so as to allow the display of a GUIscreen to be controlled in accordance with the MHEG system.

The MHEG contents of the MHEG scenes shown in FIGS. 16A to 16F areedited by using the MHEG authoring tool shown in FIGS. 18A and 18B andbroadcasted as a data broadcast. In this case, the IRD 12 outputs anddisplays an MHEG picture in display formats as shown in FIGS. 16C to16F.

FIG. 19 is a diagram showing a typical actual configuration of the MHEGauthoring tool provided by this embodiment.

In actuality, the MHEG authoring tool 42 typically comprises a personalcomputer 201 and MHEG authoring software 210 activated in the personalcomputer 201.

As shown in the figure, the personal computer 201 of the MHEG authoringtool 42 physically includes hardware 202.

The hardware 202 comprises a CPU (Central Processing Unit) 202 a, a RAM(Random-Access Memory) 202 b, a ROM 202 c and an interface 202 d. TheCPU 202 a executes various kinds of control and carries out a variety ofoperations. The RAM 202 b is used for storing information such as anapplication program executed by the CPU 202 a and data generated as aresult of processing carried out by the CPU 202 a. The ROM 202 c is usedfor storing information required for operations of the personal computer201. The interface 202 d is provided for facilitating exchanges ofinformation between the hardware 202 and external equipment and externaloperation units to be described later.

It should be noted that the hardware 202 may include a variety of otherdevices.

A basic program is executed on this hardware 202 as an operating system203 to provide an environment that allows MHEG authoring software ofthis embodiment to be executed.

The external equipment and the external operation units connected to thepersonal computer 201 shown in the figure include a display unit 221, amouse 222, a keyboard 223, a speaker 224, a storage device 225 and avideo unit 226.

The display unit 221 displays a picture output by the personal computer201. Specifically, in this embodiment, a GUI screen for editing workusing the MHEG authoring software 210 to be described later is alsodisplayed.

The mouse 222 and the keyboard 223 each serve as an operator unit usedby the editor for entering operation information to the personalcomputer 201.

The speaker 224 is provided for outputting an audio signal generated bythe personal computer 201 to the outside.

The storage device 225 stores information required by the personalcomputer 201. Examples of such information are the operating system 203and predetermined application software including the MHEG authoringsoftware 210 provided by this embodiment. In the case of thisembodiment, the stored information also includes MHEG contentsthemselves and objects used for forming each of the MHEG contents suchas picture files, sound files and text files. The MHEG authoringsoftware 210 is executed to create files of these objects to be storedin the storage device 225 and to carry out editing work by using thefiles of these objects.

It should be noted that, it is desirable to use a storage unit capableof accommodating a relatively large amount of data as the storage device225, for example, a hard-disc drive.

A typical video unit 226 is a VTR which is capable of recording andplaying back video information onto and from a video tape or a videodisc.

An example of an MHEG content is a scene change synchronized with abroadcast program comprising pictures and sounds. In processing to editan MHEG content synchronized with such a broadcast program, the videounit 226 can be used typically for playing back the broadcast programcomprising pictures and sounds.

Next, the MHEG authoring software 210 is explained.

As described earlier, the MHEG authoring software 210 is an applicationsoftware operating on the personal computer 201. The program is storedin the storage device 225.

After being read out from the storage device 225 for activation as aprogram, the MHEG authoring software 210 can be represented asfunctional blocks shown in the figure.

It should be noted that, the MHEG authoring software 210 has aconfiguration (not shown) in which information is exchanged between thefunctional blocks to allow required functions of the MHEG authoringsoftware 210 to be executed.

In the MHEG authoring software 210, an object creation module 211 is afunctional block comprising programs used for creating a file used as anobject. For example, the editor may use the keyboard 223, the mouse 222and other components in conjunction with the programs of the objectcreation module 211 or a GUI screen displayed on the display unit 221 tocreate a file used as an object. If the object created is a picture, forexample, the editor is capable of creating the object by rendering apicture file using functions of the object creation module 211. Inaddition to a picture file, according to the prescription, the createdobject may be a text file or a sound file. In this case, of course, theobject creation module 211 can be used for forming a text or sound file.An object file created by using the object creation module 211 can bestored and retained in the storage device 225.

A shared-scene creation module 212 comprises programs for creating ashared scene by utilizing object files created by using the objectcreation module 211.

In this case, for example, the editor is capable of creating anyarbitrary number of shared scenes as long as the number is smaller thanan upper limit prescribed by the MHEG authoring software 210. Much likean object file, a shared scene is created by operating the keyboard 223,the mouse 222 and other components which are used in conjunction withthe programs of the shared-scene creation unit 212 to select anyarbitrary number of object files created so far.

An MHEG-scene creation module 213 is a functional block comprisingprograms used for creating an MHEG scene. The programs of the MHEG-scenecreation module 213 are used for selecting an object file created byusing the object creation module 211 and the selected object file isused for creating an MHEG scene.

Programs of a shared-scene processing module 216 are executed to performprocessing to edit a relation between an MHEG scene and a shared scenein accordance with an operation carried out by the editor for the GUIscreen thereof. Specifically, the shared-scene processing module 216 isprogrammed for editing work such as setting a shared scene on an MHEGscene as shown in FIGS. 16A to 16F and specifying an order ofsuperposing a plurality of shared scenes to be used on an MHEG scene asshown in FIGS. 17A to 17D.

Details of an MHEG content creation module 214 are not explained.Briefly speaking, the MHEG content creation module 214 is used forcreating a scenario explained earlier by referring to FIG. 14 inaccordance with a result of editing predetermined contents of typicallya scene.

The MHEG-application creation module 215 integrates results of editingwork carried out by using the object creation module 211, theshared-scene creation module 212, the MHEG-scene creation module 213,the MHEG content creation module 214 and the shared-scene processingmodule 216 described so far to create an MHEG-application file (or anMHEG content) controlled in accordance with an internal format. In orderto implement this function, in the MHEG-application creation module 215provided by this embodiment, a description file containing “authoringcontrol information” also shown earlier in FIG. 18A is generated and theMHEG content is controlled in accordance with the internal format. Here,the authoring control information also includes a shared-scenedefinition statement created on the basis of an editing result producedby the shared-scene processing module 216 and a description file of ascenario created by using the MHEG content creation module 214. Inaddition, transitions among scenes can also be controlled in accordancewith the internal format by using the authoring control informationdescribed by using the MHEG-application creation module 215.

Furthermore, control information for the synchronization of a sceneoutput in the broadcasting time of a broadcast program is also describedas authoring control information. When the authoring control informationis converted into the MHEG-IS format, the contents of the description ofthe control information for synchronization are also converted andoutput.

Information obtained as an MHEG content created by using theMHEG-application creation module 215 as described above is handled inaccordance with an internal format by the MHEG authoring software asexplained earlier by referring to FIGS. 18A and 18B.

Then, in this embodiment, an MHEG application file created in accordancewith the internal format can be output to the external by processingcarried out by an internal-format-file output control module 217 as aninternal-format file with the internal format remaining unchanged as itis.

For example, an internal-format file of an MHEG application output bythe internal-format-file output control module 217 can be stored andretained in the storage device 225. By doing so, the internal-formatfile stored in the storage device 225 can be transferred later to thepersonal computer 201 which is capable of changing editing contents byexecution of the MHEG authoring software 210.

An MHEG-script output control module 218 receives data of anMHEG-application file created by the MHEG-application creation module215 in the internal format, converts the data into a description of ascript (or control information) conforming to the actual MHEGspecifications and outputs, outputting the description to the external.That is to say, the MHEG-script output control module 218 outputs aregular MHEG (MHEG-IS) application file.

Typically, the output of the MHEG-script output control module 218 issupplied to the DSM-CC encoder 44 shown in FIG. 5.

It should be noted that an MHEG application file of the MHEG-IS formatproduced by the MHEG-script output control module 218 can be stored andretained in the storage device 225. In actuality, an application file ofthe MHEG-IS format stored and retained in the storage device 225 issupplied to the DSM-CC encoder 44 employed in the ground station 1 whenrequired.

In comprising the configuration of the MHEG authoring software explainedso far with the processing shown in FIGS. 18A and 18B, the functionalcircuit blocks of the software correspond to the processing according tothe internal format of the MHEG authoring tool shown in FIG. 18A. Asdescribed earlier, the functional circuit blocks are the object creationmodule 211, the shared-scene creation module 212, the MHEG scenecreation module 213, the MHEG content creation module 214, the MHEGapplication creation module 215, the shared-scene processing module 216and the internal-format file output control module 217.

In addition, the object creation module 211 corresponds to theprocessing shown in FIG. 18B to convert MHEG application informationexpressed in the internal format into an MHEG-IS output.

2-4 Typical GUI Screens Displayed as Part of MHEG Authoring Software

As described above, the MHEG authoring software 210 provided by thisembodiment is application software running on the personal computer 201.The MHEG authoring software 210 is also capable of carrying outcommand-line editing typically for describing a script conforming to theMHEG specifications. In order to allow a variety of editing operationsto be carried out as visually as possible, mainly including the editingof a shared scene described earlier, the MHEG authoring software 210 hasan operation style embracing the GUI. That is to say, much like variouskinds of software developed in recent years for personal computers, theMHEG authoring software 210 allows the editor to carry out editingoperations by operating the mouse 222 and the keyboard 223 while lookingat an operation screen appearing on the display unit 212.

It should be noted that an operation on an interface such as the GUI canbe implemented with ease by typically carrying out edit processingaccording to the internal format in the MHEG authoring software 210 asdescribed earlier.

FIGS. 20A and 20B are diagrams showing a typical display format of a GUIscreen for editing operations carried out by using the MHEG authoringsoftware 210 provided by this embodiment. In particular, the figureshows a GUI screen related to shared-scene editing which is acharacteristic of this embodiment.

In particular, FIG. 20A is a diagram showing a typical basic displayformat of a GUI screen for creating an MHEG application file. Thepicture of the GUI screen is displayed typically on the display unit221.

As shown in FIG. 20A, the screen displays an MHEG application window WD1and a shared-scene control window WD2.

The MHEG application window WD1 is a window for visually displaying thestructure of an MHEG application created by the editor. For example, thewindow has a title of “MHEG Application”.

In the first place, on the left side of the MHEG application window WD1,a column with a title of “Scene” is displayed for presenting a list ofMHEG scenes constituting this MHEG application. In this example, thescene column displays 5 MHEG scenes, namely MHEG scenes 1 to 5.

It should be noted that, in case there are too many MHEG scenesconstituting the MHEG application so that all the MHEG scenes can not beaccommodated in the display area of the MHEG application window WD1, theMHEG application window WD1 can be displayed, for example, in a formatthat allows the window to be scrolled.

In the second place, on the right side of the MHEG application windowWD1, a column with a title of “Shared-Scene Setting Status” is displayedfor visually displaying the present setting status of the MHEG scenes.The setting status of an MHEG scene shows which shared scenes are usedand, if a plurality of shared scenes are in use, the status specifieswhat order the shared scenes are to be superposed in.

On the “Shared-Scene Setting Status” column, 1 shared scene is expressedby an icon which is referred to as a shared-scene icon Ish. Ashared-scene icon Ish is denoted by notation shsN where N is a naturalnumber, that is, a positive integer denoting the number of a file of theshared scene.

Take MHEG scene 1 as an example. In this case, the status shows thatonly one shared-scene icon Ish marked with “shs1” is displayed toindicate that only shared scene 1 is used to create MHEG scene 1.Likewise, in the case of MHEG scene 2, only shared scene 1 is used tocreate MHEG scene 2.

Similarly, in the case of MHEG scene 4, the status shows that only oneshared-scene icon Ish marked with “shs2” is displayed to indicate thatonly shared scene 2 is used to create MHEG scene 4. By the same token,in the case of MHEG scene 5, the status shows that only one shared-sceneicon Ish marked with “shs6” is displayed to indicate that only sharedscene 6 is used to create MHEG scene 5.

In the case of MHEG scene 3, on the other hand, the status shows thattwo shared-scene icons Ish marked with “shs1” and “shs2” are set toindicate that two shared scenes 1 and 2 are used to create MHEG scene 5.The fact that shared scene 1 is placed first on the row to be followedby shared scene 2 indicates that shared scene 1 denoted by shs1 is to bedisplayed first on MHEG scene 3 to be followed by shared scene 2 denotedby shs2. That is to say, the status specifies an order of superpositionin which shared scene 1 is placed on the front side and shared scene 2is placed on the rear side.

As described above, the shared-scene control window WD2 is displayed onthe right side adjacent the MHEG application window WD1.

The shared-scene control window WD2 has a title of “Shared Scenes” toindicate that this window shows a list of shared scenes created andprepared by the editor. In this example, the shared-scene control windowWD2 presently displays 6 shared scenes, namely, shared scenes 1 to 6.

The shared scenes set on the “Shared-Scene Setting Status” column of theMHEG application window WD1 described above for each MHEG scene areselected arbitrarily from the shared scenes on the list displayed on theshared-scene control window WD2.

There are a variety of possible operations to select a shared scene fromthe list. In an example of the possible operations, a shared scenearbitrarily selected from the list on the shared-scene control windowWD2 is moved to the position of a shared-scene icon for any arbitraryMHEG scene on the “Shared-Scene Setting Status” column on the MHEGapplication window WD1 by carrying out a drag-and-drop operation.

In addition, the specification of an order of superposition for an MHEGscene on the “Shared-Scene Setting Status” column on the MHEGapplication window WD1 can be changed by carrying out a drag-and-dropoperation cited above.

Assume for example that, with the screen of FIG. 20A displayed, anyarbitrary one of MHEG scenes 1 to 5 is selected by using typically apull-down menu which is not shown in the figure. Then, a predeterminedoperation is carried out to call an edit screen (or a window) for theselected MHEG scene. FIG. 20B is a diagram showing a typical scene editscreen.

Assume for example that the scene edit screen shown in FIG. 20B is ascreen for MHEG scene 1. In this case, the scene edit screen displaysthe picture of MHEG scene 1 which uses shared scene 1. In this figure,an object included in shared scene 1 is shown as a hatched ellipse.

2-5 Processing Operations

The following description explains a variety of processing operationscarried out by a CPU 202 a employed in the hardware 202 shown in FIG. 19by execution of the MHEG authoring software 210 provided by thisembodiment. The processing operations are exemplified by processing toedit a shared scene which is a characteristic of the embodiment.

FIG. 21 is a flowchart showing processing operations carried out tocreate a shared scene. The operations are carried out by execution ofprograms of mainly the shared-scene creation module 212 and theMHEG-application creation module 215 included in the MHEG authoringsoftware 210.

As shown in the figure, the processing begins with step S101 at which ashared scene is created in accordance with operations carried out by theeditor.

In order to create a shared scene, a shared scene creation screen ispresented as a GUI screen in a format like a typical one shown in FIG.20B. The editor then creates a picture to be used as a shared scene bypasting objects selected arbitrarily from already prepared objects suchas picture and text files on the shared-scene creation screen.

At step S101, display control processing is carried out to change theappearance of the GUI screen in accordance with such an operation tocreate a shared scene described above. In addition, an operation tocreate a shared scene also causes information on a temporary sharedscene to be controlled in accordance with an internal format.

In this embodiment, a variety of editing results for an MHEG applicationtypically including shared scenes are controlled in the MHEG-applicationcreation module 215 by being described as authoring control informationaccording to the internal format.

Then, at step S102, a description according to contents of the sharedscene created at step S101 is written as the authoring controlinformation according to the internal format.

Subsequently, at step S103, the shared scene created at step S101 iscontrolled as a file and stored and retained in the storage device 225.It should be noted, however, that information contained in the storedfile of the shared scene also conforms to the internal format.

The processing up to this point is carried out to create a certainshared scene which can be stored as a file conforming to the internalformat. Then, this procedure (or processing) is carried out for eachshared scene so as to allow shared-scene files required for creation ofan MHEG scene to be prepared. It should be noted that a directory ofshared-scene files stored in this way is controlled as authoring controlinformation in the MHEG-application creation module 215.

FIG. 22 is a diagram showing processing operations to set a shared scenefor an MHEG scene. The operations are carried out by execution ofprograms of mainly the shared-scene processing module 216 and theMHEG-application creation module 215.

At a stage prior to the processing shown in FIG. 22, MHEG scenes andshared scenes are prepared to create the MHEG content. It should benoted that the creation of an MHEG scene itself is not described before.The creation of an MHEG scene is implemented by displaying theMHEG-scene creation screen and having the editor create the MHEG sceneon the screen using the MHEG-scene creation module 213.

As shown in FIG. 22, the processing begins with step S201 at whichprocessing to set shared scenes for each MHEG scene is carried out inaccordance with an operation performed by the editor.

That is to say, in accordance with an operation to set shared scenes foran MHEG scene as described earlier, processing is carried out, for amongother purposes, to output a GUI picture like the one shown in FIGS. 20Aand 20B as a result of editing. In the operation to set shared scenesfor an MHEG scene, shared scenes to be used for the MHEG scene and anorder of superposition of the shared scenes are specified.

Then, when shared scenes are set for a certain MHEG scene as describedabove, the setting of the shared scenes for the MHEG scene is describedas authoring control information at step S202. To put it concretely, ashared-scene definition statement explained earlier by referring toFIGS. 18A and 18B is created.

In actuality, the processing shown in FIG. 22 is carried out for eachMHEG scene. Then, the setting of shared scenes for each MHEG sceneobtained as a result of operations carried out by the editor during suchprocessing is described by the MHEG-application creation module 215 asauthoring control information.

The steps of processing shown in FIGS. 21 and 22 are thus processingcarried out by execution of the MHEG authoring software 210 inaccordance with an internal format to edit an MHEG application providedby this embodiment by creation of shared scenes and setting the sharedscenes for each MHEG scene.

It should be noted that authoring control information created in thesteps shown in FIGS. 21 and 22 can be stored in the storage device 225as information on an MHEG application according to the internal formatalong with typically a variety of files used mainly as objects throughprocessing of the internal-format-file output control module 217. It isworth noting, however, that operations of the processing of theinternal-format-file output control module 217 are not shown explicitlyin FIGS. 21 and 22.

In order to output the MHEG application conforming to the internalformat as described above as a data content for broadcasting, that is,in order to output content information controlled by authoring controlinformation as a broadcasting data content, it is necessary to convertthe format of the MHEG application into an MHEG-IS format as has beendescribed earlier by referring to FIGS. 18A and 18B. In the followingdescription, description contents of a script conforming to the MHEG-ISformat is referred to as an MHEG-IS script. The following descriptionexplains processing to convert information on an MHEG application fromthe internal format into the MHEG-IS format of an MHEG script withreference to FIGS. 23 and 24. This conversion processing is carried outin an environment where the MHEG authoring software 210 is executed.

It should be noted, however, that the explanation of the conversionprocessing is limited in this case to a shared scene or a shared objectwhich is a characteristic of this embodiment.

In addition, the processing described below is carried out by executingprograms of the MHEG-script output control module 218.

FIG. 23 is a diagram showing preparatory processing to output a resultof editing a shared scene as an MHEG script. Typically, after thispreparatory processing is completed, the conversion processing shown inFIG. 24 is actually carried out to produce an MHEG script.

As shown in FIG. 23, the processing begins with a step S301 to fetchinformation on an MHEG application described in the internal format ofthe MHEG authoring software 210. Shared objects are controlled inauthoring control information as objects forming a shared scene.

Then, at next step S302, the contents of the MHEG application fetched atstep S301 are analyzed to acquire all shared scenes which are includedin this MHEG application and set for use in MHEG scenes of the MHEGapplication.

Subsequently, at step S303, processing is carried out to set all theobjects used in the shared scenes obtained at step S302 in the MHEGapplication (or the MHEG script) as shared objects.

To put it concretely, the following MHEG script is described in thisprocessing.

In the MHEG script, a shared object is defined by a description of a“Shared” parameter which represents an attribute of the object asfollows.

Shared=True

indicates that the object is prescribed as a shared object.

On the other hand,

Shared=False

indicates that the object is prescribed to be not a shared object.

Thus, at step S303, the attribute of each object used in the sharedscenes obtained at the step S302 is described as follows:

Shared=True

By describing the attribute in this way, all the objects are eachtreated as a shared object.

Another parameter of an object, Initially Active is defined as aparameter set to indicate whether the object is active or inactive in aninitial state in an MHEG scene or an MHEG application.

Initially Active=True

indicates that the object is active initially.

On the other hand,

Initially Active=False indicates that the object is inactive initially.

Finally, at step S304, for each of the shared objects set at step S303,this parameter is set as follows.

Initially Active=False

That is to say, each of the shared objects is inactive initially.

Next, processing shown in FIG. 24 is explained.

As shown in the figure, the processing begins with step S401 at whichthe preparatory processing explained earlier by referring to FIG. 23 iscarried out.

When the preparatory processing is completed, the processing flow goeson to step S402.

At step S402, a fetched MHEG application is examined to determinewhether or not one or more MHEG scenes are set and used in the MHEGapplication. Typically, the judgment is formed by referring to authoringcontrol information conforming to the internal format.

If it is determined that MHEG scenes to be used are not set in the MHEGapplication, no processing is specially required for shared scenes and,the processing is ended. If it is determined that MHEG scenes to be usedare set in the MHEG application, on the other hand, the flow of theprocessing goes on to step S403.

At step S403, the MHEG application is checked to determine whether ornot there is still an unselected MHEG scene which remains to besubjected to convert a shared scene into a shared object. Thus, when theflow goes on from step S402 to step S403 for the first time, thedetermination formed ate step S403 certainly indicates that there is anMHEG scene to be subjected to such conversion processing. In this case,the flow of the processing proceeds to step S404.

At step S404, one of presently set MHEG scenes is selected and theauthoring control information of the selected MHEG scene is fetched asan object of processing. Typically, an MHEG scene is selectedsequentially according to an MHEG-scene sequence number.

It should be noted that MHEG scenes once selected before at step S404are no longer subjected to the subsequent processing.

At step S405, a link is described as an MHEG script to indicate that allshared objects are to be stopped (turned off) at activation of this MHEGscene. To put it concretely, for all shared objects included in the MHEGapplication, an MHEG script regarding shared objects for this MHEG sceneis described as follows:

Initially Active=False

The prescription obtained as an actual editing result thus indicatesthat, in this MHEG scene, shared objects are not used at all.

At step S406, the authoring control information (or shared-scenedefinition statements) of the selected MHEG scene fetched at step S404is referred to in order to determine whether or not there is a sharedscene set for the MHEG scene.

If it is determined that there is no shared scene set for the MHEGscene, the flow of the processing goes back to step S403.

If it is determined S406 indicated that there is a shared scene set forthe MHEG scene, on the other hand, the flow of the processing goes on tostep S407.

At step S407, the MHEG scene is checked to determine whether or notthere is still an unselected shared scene which remains to be processedto convert the shared scene into a shared object. Thus, when the flowgoes on from step S405 to step S406 for the first time, it has beendetermined at step S407 that there is a shared scene to be subjected tosuch conversion processing. In this case, the flow of the processingproceeds to step S408.

At step S408, one of unselected MHEG scenes remaining as an object ofthe conversion processing is selected. To put it in detail, processingis carried out to select and fetch the description contents such as ashared-scene definition statement on a shared scene which has beenplaced at the rearmost end.

It should be noted that shared scenes once selected before at step S408are no longer subjected to the subsequent processing.

Next, at step S409, processing is carried out to describe a link as anMHEG script to run or turn on shared objects included in the sharedscene fetched at step S408 at activation of the MHEG scene fetched atstep S404 as a current processing object. In order to describe a link torun shared objects, typically, the following is described for each ofthe shared objects.

If initially Active=True,

the MHEG script prescribes that the shared objects serving as a materialof the shared scene fetched at step S408 be put in an active state atactivation of the MHEG scene and displayed at proper positions on thedisplay screen.

As the processing of step S409 is completed, the flow goes back to stepS407. If determination formed ate step S407 indicates that there is ashared scene to be subjected to such conversion processing, the flow ofthe processing proceeds to step S408 to carry out the processing of stepS408 and the subsequent processing.

The pieces of processing of steps S407 to S409 are carried outrepeatedly for a selected and fetched MHEG scene as many times as thenumber of shared scenes set for the MHEG scene.

By carrying out steps S407 to S409 repeatedly, it is possible to obtaindescription contents of an MHEG script specifying utilization of sharedobjects in a certain MHEG scene in accordance with results of workcarried out earlier by the editor to edit shared scenes. At the sametime, it is also possible to obtain description contents of an MHEGscript specifying an order of superposition of the shared objects.

As described above, steps S407 to S409 are carried out repeatedly for anMHEG scene as many times as the number of shared scenes set for the MHEGscene. When no more shared scenes remain, the flow of the processinggoes back to step S403.

When the flow of the processing returns to step S403 from step S409 orS406 and it is determined in step S403 that there is an MHEG scene leftas an object of the conversion processing, the flow goes on to step S404to carry out the processing of step 404 and the subsequent processing.

Thus, steps S403 to S409 are carried out repeatedly for an MHEGapplication file (or an MHEG content) as many times as the number ofMHEG scenes created for the MHEG content.

After steps S403 to S409 have been completed, step S403 indicates thatthe processing is ended.

In this way, at the stage the processing carried out so far is ended, aninternal-format result of editing work performed by using the MHEGauthoring software in accordance with operations carried out by theeditor has been converted into description contents of an MHEG scriptconforming to the MHEG-IS format.

It should be noted that FIGS. 23 and 24 show the processing of theMHEG-script output control module 218 to convert the internal format ofa description of an MHEG content into the MHEG-IS format.

Thus, in actuality, processing to convert the internal format into theMHEG-IS format for an editing result of an MHEG content other than theshared scene is carried out concurrently with the processing shown inFIGS. 23 and 24.

In addition, the pieces of processing shown in FIGS. 23 and 24 are eachtypical processing to the bitter end. There are other conceivableprocessing procedures for converting description contents with theinternal format of the MHEG authoring software using the concept ofshared scenes into description contents with the MHEG-IS format based onthe concept of shared objects.

The above embodiment is exemplified by a case in the digital satellitebroadcasting system created in accordance with the MHEG specifications.In addition, a content created by the present invention can also be usedin media other than the digital satellite broadcasting system. As forthe media, a recording medium such as a CD-ROM can also be used inaddition to distribution through a broadcasting system and a network.

Furthermore, while the embodiment is exemplified by a case in which anMHEG content is edited, the present invention can also be applied toapplications other than the MHEG system provided that the otherapplications conform to specifications for creating an interface picture(a content) introducing a concept similar to, for example, the conceptof a shared object.

As described above, the present invention defines a shared scene thatcan be created by using any arbitrary objects as a virtual scene usableas a scene common to scenes instead of directly handling the sharedobject on an authoring tool in editing work to create a contentconforming to typically the MHEG specifications. In addition, thepresent invention is used for editing scenes in shared-scene units.Then, the edited work using the shared scene is finally converted intodescription contents for controlling a shared object itself inaccordance with specifications for a content for broadcasting.

With such a configuration, an editor creating a content is capable ofhanding a shared object by carrying out operations to combine sharedscenes created arbitrarily for a scene at an editing-operation stageusing the authoring tool. Conversely speaking, it is not necessary forthe editor to have advance knowledge of the MHEG script.

Thus, by virtue of the present invention, the editor is capable ofediting a scene using a shared object with ease and with a high degreeof accuracy even if the editor is not familiar with rules of an MHEGscript, for example. As a result, the present invention provides aneffect to give the editor a capability of creating a scene in a numberof display formats through editing operations which are easy tounderstand.

In addition, as described above, the present invention provides a systemof editing operations in which a shared object is handled for eachshared scene and, in addition, an order of superposition of sharedscenes can be specified. As a result, it is possible to simplify acomparatively complicated edit operation of specifying an order ofsuperposition of objects.

The invention claimed is:
 1. A receiving apparatus allowing display offinal superimposed scenes from content information according to apredetermined specification, the receiving apparatus comprising: areceiver adapted to receive a shared object control information used forforming final superimposed scenes that are formed by combining two ormore shared scenes and that include arbitrary objects, wherein theshared scenes are the virtual scenes which are created by using two ormore arbitrary objects; the shared object control information beingformed from control information described in accordance with an internalformat based on the two or more shared scenes, the two or more sharedscenes being virtual scenes formed of individual graphical userinterface screens in accordance with the internal format and used toform the final superimposed scenes, the final superimposed scenes beingformed by superimposition of the individual graphical user interfacescreens of the two or more shared scenes, each of the individualgraphical user interface screens of the two or more shared scenesincluding two or more of the arbitrary objects, the arbitrary objectsbeing user-selectable command objects that are separately controllableindependent of the shared scenes in which the arbitrary objects aredisplayed in accordance with the predetermined specification; and aprocessor comprising instructions for processing the shared objectcontrol information to form the final superimposed scenes in which theshared objects are specified for display at the same time in the finalsuperimposed scenes in accordance with the predetermined specification,wherein the superimposed final scenes are described by the combinationof the individual graphical user interface screens of the two or moreshared scenes and one or more of the shared objects based on theinternal format, and the control information is described based on oneor more of the shared objects without the shared scenes.
 2. A receivingapparatus according to claim 1, wherein the object control informationspecifies a state of utilization of shared objects in each of the finalsuperimposed scenes in accordance with an order of superposition of theindividual graphical user interface screens of the two or more sharedscenes.
 3. A receiving apparatus according to claim 1, wherein thepredetermined specification comprises a predetermined broadcastingspecification.
 4. A non-transitory storage device stored thereininstruction, when implemented by a personal computer allowing display offinal superimposed scenes from content information according to apredetermined specification, comprising: receiving a shared objectcontrol information used for forming final superimposed scenes that areformed by combining two or more shared scenes and that include arbitraryobjects, wherein the shared scenes are the virtual scenes which arecreated by using two or more arbitrary objects; the shared objectcontrol information being formed from control information described inaccordance with an internal format based on the two or more sharedscenes, the two or more shared scenes being virtual scenes formed ofindividual graphical user interface screens in accordance with theinternal format and used to form the final superimposed scenes, thefinal superimposed scenes being formed by superimposition of theindividual graphical user interface screens of the two or more sharedscenes, each of the individual graphical user interface screens of thetwo or more shared scenes including two or more of the arbitraryobjects, the arbitrary objects being user-selectable command objectsthat are separately controllable independent of the shared scenes inwhich the arbitrary objects are displayed in accordance with thepredetermined specification; and processing the shared object controlinformation to form the final superimposed scenes in which the sharedobjects are specified for display at the same time in the finalsuperimposed scenes in accordance with the predetermined specification,wherein the superimposed final scenes are described by the combinationof the individual graphical user interface screens of the two or moreshared scenes and one or more of the shared objects based on theinternal format, and the control information is described based on oneor more of the shared objects without the shared scenes.
 5. A receivingnon-transitory storage device according to claim 4, wherein thepredetermined specification comprises a predetermined broadcastingspecification.
 6. A receiving non-transitory storage device according toclaim 4, wherein the object control information specifies a state ofutilization of shared objects in each of the final superimposed scenesin accordance with an order of superposition of the individual graphicaluser interface screens of the two or more shared scenes.
 7. A method ofprocessing information received at a receiving apparatus comprising areceiver and processor programmed to allow the display of finalsuperimposed scenes from content information according to apredetermined specification, the method comprising: receiving, at areceiver, a shared object control information used for forming finalsuperimposed scenes that are formed by combining two or more sharedscenes and that include arbitrary objects, wherein the shared scenes arethe virtual scenes which are created by using two or more arbitraryobjects; the shared object control information being formed from controlinformation described in accordance with an internal format based on thetwo or more shared scenes, the two or more shared scenes being virtualscenes formed of individual graphical user interface screens inaccordance with the internal format and used to form the finalsuperimposed scenes, the final superimposed scenes being formed bysuperimposition of the individual graphical user interface screens ofthe two or more shared scenes, each of the individual graphical userinterface screens of the two or more shared scenes including two or moreof the arbitrary objects, the arbitrary objects being user-selectablecommand objects that are separately controllable independent of theshared scenes in which the arbitrary objects are displayed in accordancewith the predetermined specification; and processing, at the receiver,the shared object control information to form the final superimposedscenes in which the shared objects are specified for display at the sametime in the final superimposed scenes in accordance with thepredetermined specification, wherein the superimposed final scenes aredescribed by the combination of the individual graphical user interfacescreens of the two or more shared scenes and one or more of the sharedobjects based on the internal format, and the control information isdescribed based on one or more of the shared objects without the sharedscenes.
 8. A method according to claim 7, further comprising controllingutilization of the at least one shared object in each of the finalsuperimposed scenes based upon the predetermined specification and theshared scenes.
 9. A method according to claim 8, further comprising:receiving information specifying an order of superposition of theindividual graphical user interface screens of the two or more sharedscenes; and wherein the control information controls an order ofsuperposition of the shared objects based upon the order ofsuperposition of the individual graphical user interface screens of thetwo or more shared scenes.
 10. A receiving method according to claim 7,wherein the predetermined specification comprises a data broadcastingspecification.